Nov 14 19:04:15 user nova-compute[75205]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75205) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75205) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75205) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 19:04:15 user nova-compute[75205]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:04:15 user nova-compute[75205]: INFO nova.virt.driver [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 19:04:15 user nova-compute[75205]: INFO nova.compute.provider_config [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] Acquiring lock "singleton_lock" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] Acquired lock "singleton_lock" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] Releasing lock "singleton_lock" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] Full set of CONF: {{(pid=75205) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ******************************************************************************** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] Configuration options gathered from: {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ================================================================================ {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] allow_resize_to_same_host      = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] arq_binding_timeout            = 300 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] backdoor_port                  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] backdoor_socket                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] block_device_allocate_retries  = 300 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] block_device_allocate_retries_interval = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cert                           = self.pem {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute_monitors               = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] config_dir                     = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] config_drive_format            = iso9660 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] config_source                  = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] console_host                   = user {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] control_exchange               = nova {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cpu_allocation_ratio           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] daemon                         = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] debug                          = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] default_access_ip_network_name = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] default_availability_zone      = nova {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] default_ephemeral_format       = ext4 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] default_green_pool_size        = 1000 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] default_schedule_zone          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] disk_allocation_ratio          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] enable_new_services            = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] enabled_ssl_apis               = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] flat_injected                  = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] force_config_drive             = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] force_raw_images               = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] graceful_shutdown_timeout      = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] heal_instance_info_cache_interval = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] host                           = user {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] instance_build_timeout         = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] instance_delete_interval       = 300 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] instance_name_template         = instance-%08x {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] instance_usage_audit           = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] instance_usage_audit_period    = month {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] internal_service_availability_zone = internal {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] key                            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] live_migration_retry_count     = 30 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] log_config_append              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] log_dir                        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] log_file                       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] log_options                    = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] log_rotate_interval            = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] log_rotate_interval_type       = days {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] log_rotation_type              = none {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] long_rpc_timeout               = 1800 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] max_concurrent_builds          = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] max_concurrent_live_migrations = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] max_concurrent_snapshots       = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] max_local_block_devices        = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] max_logfile_count              = 30 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] max_logfile_size_mb            = 200 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] maximum_instance_delete_attempts = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] metadata_listen                = 0.0.0.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] metadata_listen_port           = 8775 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] metadata_workers               = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] migrate_max_retries            = -1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] mkisofs_cmd                    = genisoimage {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] my_ip                          = 10.0.0.210 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] network_allocate_retries       = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] osapi_compute_listen_port      = 8774 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] osapi_compute_unique_server_name_scope =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] osapi_compute_workers          = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] password_length                = 12 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] periodic_enable                = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] periodic_fuzzy_delay           = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] pointer_model                  = ps2mouse {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] preallocate_images             = none {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] publish_errors                 = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] pybasedir                      = /opt/stack/nova {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ram_allocation_ratio           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] rate_limit_burst               = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] rate_limit_except_level        = CRITICAL {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] rate_limit_interval            = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] reboot_timeout                 = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] reclaim_instance_interval      = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] record                         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] reimage_timeout_per_gb         = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] report_interval                = 120 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] rescue_timeout                 = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] reserved_host_cpus             = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] reserved_host_disk_mb          = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] reserved_host_memory_mb        = 512 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] reserved_huge_pages            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] resize_confirm_window          = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] resize_fs_using_block_device   = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] resume_guests_state_on_host_boot = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] rpc_response_timeout           = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] run_external_periodic_tasks    = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] running_deleted_instance_action = reap {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] running_deleted_instance_timeout = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler_instance_sync_interval = 120 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_down_time              = 720 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] servicegroup_driver            = db {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] shelved_offload_time           = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] shelved_poll_interval          = 3600 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] shutdown_timeout               = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] source_is_ipv6                 = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ssl_only                       = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] state_path                     = /opt/stack/data/nova {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] sync_power_state_interval      = 600 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] sync_power_state_pool_size     = 1000 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] syslog_log_facility            = LOG_USER {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] tempdir                        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] timeout_nbd                    = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] transport_url                  = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] update_resources_interval      = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] use_cow_images                 = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] use_eventlog                   = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] use_journal                    = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] use_json                       = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] use_rootwrap_daemon            = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] use_stderr                     = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] use_syslog                     = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vcpu_pin_set                   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plugging_is_fatal          = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plugging_timeout           = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] virt_mkfs                      = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] volume_usage_poll_interval     = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] watch_log_file                 = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] web                            = /usr/share/spice-html5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_concurrency.disable_process_locking = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.auth_strategy              = keystone {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.compute_link_prefix        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.dhcp_domain                = novalocal {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.enable_instance_password   = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.glance_link_prefix         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.instance_list_per_project_cells = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.list_records_by_skipping_down_cells = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.local_metadata_per_cell    = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.max_limit                  = 1000 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.metadata_cache_expiration  = 15 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.neutron_default_tenant_id  = default {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.use_forwarded_for          = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.use_neutron_default_nets   = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.vendordata_dynamic_targets = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.vendordata_jsonfile_path   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.backend_argument         = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.config_prefix            = cache.oslo {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.dead_timeout             = 60.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.debug_cache_backend      = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.enable_retry_client      = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.enable_socket_keepalive  = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.enabled                  = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.expiration_time          = 600 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.hashclient_retry_attempts = 2 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.memcache_dead_retry      = 300 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.memcache_password        =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.memcache_sasl_enabled    = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.memcache_username        =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.proxies                  = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.retry_attempts           = 2 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.retry_delay              = 0.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.socket_keepalive_count   = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.socket_keepalive_idle    = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.socket_keepalive_interval = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.tls_allowed_ciphers      = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.tls_cafile               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.tls_certfile             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.tls_enabled              = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cache.tls_keyfile              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.auth_section            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.auth_type               = password {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.cafile                  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.certfile                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.collect_timing          = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.cross_az_attach         = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.debug                   = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.endpoint_template       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.http_retries            = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.insecure                = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.keyfile                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.os_region_name          = RegionOne {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.split_loggers           = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cinder.timeout                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.cpu_dedicated_set      = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.cpu_shared_set         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.image_type_exclude_list = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.resource_provider_association_refresh = 300 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.shutdown_retry_interval = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] conductor.workers              = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] console.allowed_origins        = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] console.ssl_ciphers            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] console.ssl_minimum_version    = default {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] consoleauth.token_ttl          = 600 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.cafile                  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.certfile                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.collect_timing          = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.connect_retries         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.connect_retry_delay     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.endpoint_override       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.insecure                = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.keyfile                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.max_version             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.min_version             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.region_name             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.service_name            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.service_type            = accelerator {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.split_loggers           = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.status_code_retries     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.status_code_retry_delay = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.timeout                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] cyborg.version                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.backend               = sqlalchemy {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.connection            = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.connection_debug      = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.connection_parameters =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.connection_recycle_time = 3600 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.connection_trace      = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.db_inc_retry_interval = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.db_max_retries        = 20 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.db_max_retry_interval = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.db_retry_interval     = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.max_overflow          = 50 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.max_pool_size         = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.max_retries           = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.mysql_wsrep_sync_wait = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.pool_timeout          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.retry_interval        = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.slave_connection      = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] database.sqlite_synchronous    = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.backend           = sqlalchemy {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.connection        = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.connection_debug  = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.connection_parameters =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.connection_recycle_time = 3600 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.connection_trace  = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.db_inc_retry_interval = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.db_max_retries    = 20 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.db_max_retry_interval = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.db_retry_interval = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.max_overflow      = 50 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.max_pool_size     = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.max_retries       = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.pool_timeout      = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.retry_interval    = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.slave_connection  = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] api_database.sqlite_synchronous = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] devices.enabled_mdev_types     = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ephemeral_storage_encryption.enabled = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.api_servers             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.cafile                  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.certfile                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.collect_timing          = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.connect_retries         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.connect_retry_delay     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.debug                   = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.default_trusted_certificate_ids = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.enable_certificate_validation = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.enable_rbd_download     = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.endpoint_override       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.insecure                = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.keyfile                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.max_version             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.min_version             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.num_retries             = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.rbd_ceph_conf           =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.rbd_connect_timeout     = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.rbd_pool                =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.rbd_user                =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.region_name             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.service_name            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.service_type            = image {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.split_loggers           = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.status_code_retries     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.status_code_retry_delay = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.timeout                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.verify_glance_signatures = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] glance.version                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] guestfs.debug                  = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.config_drive_cdrom      = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.config_drive_inject_password = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.enable_remotefx         = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.instances_path_share    =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.limit_cpu_features      = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.use_multipath_io        = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.vswitch_name            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] mks.enabled                    = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] image_cache.manager_interval   = 2400 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] image_cache.precache_concurrency = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] image_cache.remove_unused_base_images = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] image_cache.subdirectory_name  = _base {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.api_max_retries         = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.api_retry_interval      = 2 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.auth_section            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.auth_type               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.cafile                  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.certfile                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.collect_timing          = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.conductor_group         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.connect_retries         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.connect_retry_delay     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.endpoint_override       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.insecure                = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.keyfile                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.max_version             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.min_version             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.peer_list               = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.region_name             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.serial_console_state_timeout = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.service_name            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.service_type            = baremetal {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.split_loggers           = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.status_code_retries     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.status_code_retry_delay = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.timeout                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ironic.version                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] key_manager.fixed_key          = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.barbican_api_version  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.barbican_endpoint     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.barbican_endpoint_type = public {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.barbican_region_name  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.cafile                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.certfile              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.collect_timing        = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.insecure              = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.keyfile               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.number_of_retries     = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.retry_delay           = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.send_service_user_token = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.split_loggers         = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.timeout               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.verify_ssl            = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican.verify_ssl_path       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican_service_user.auth_section = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican_service_user.auth_type = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican_service_user.cafile   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican_service_user.certfile = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican_service_user.collect_timing = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican_service_user.insecure = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican_service_user.keyfile  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican_service_user.split_loggers = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] barbican_service_user.timeout  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.approle_role_id          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.approle_secret_id        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.cafile                   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.certfile                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.collect_timing           = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.insecure                 = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.keyfile                  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.kv_mountpoint            = secret {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.kv_path                  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.kv_version               = 2 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.namespace                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.root_token_id            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.split_loggers            = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.ssl_ca_crt_file          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.timeout                  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.use_ssl                  = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.auth_section          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.auth_type             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.cafile                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.certfile              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.collect_timing        = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.connect_retries       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.connect_retry_delay   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.endpoint_override     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.insecure              = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.keyfile               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.max_version           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.min_version           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.region_name           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.service_name          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.service_type          = identity {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.split_loggers         = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.status_code_retries   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.status_code_retry_delay = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.timeout               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] keystone.version               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.connection_uri         =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.cpu_mode               = custom {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: WARNING oslo_config.cfg [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.cpu_power_governor_high = performance {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.cpu_power_management   = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.device_detach_attempts = 8 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.device_detach_timeout  = 20 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.disk_cachemodes        = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.disk_prefix            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.enabled_perf_events    = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.file_backed_memory     = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.gid_maps               = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.hw_disk_discard        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.hw_machine_type        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.images_rbd_pool        = rbd {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.images_type            = default {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.images_volume_group    = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.inject_key             = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.inject_partition       = -2 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.inject_password        = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.iscsi_iface            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.iser_use_multipath     = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_downtime = 500 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_inbound_addr = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_scheme  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_timeout_action = abort {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_tunnelled = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: WARNING oslo_config.cfg [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 19:04:15 user nova-compute[75205]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 19:04:15 user nova-compute[75205]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 19:04:15 user nova-compute[75205]: and ``live_migration_inbound_addr`` respectively.
Nov 14 19:04:15 user nova-compute[75205]: ).  Its value may be silently ignored in the future.
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.live_migration_with_native_tls = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.max_queues             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.nfs_mount_options      = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.num_pcie_ports         = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.pmem_namespaces        = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.quobyte_client_cfg     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.rbd_secret_uuid        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.rbd_user               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.rescue_image_id        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.rescue_kernel_id       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.rx_queue_size          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.smbfs_mount_options    =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.snapshot_compression   = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.snapshot_image_format  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.sparse_logical_volumes = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.swtpm_enabled          = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.swtpm_group            = tss {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.swtpm_user             = tss {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.sysinfo_serial         = unique {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.tb_cache_size          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.tx_queue_size          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.uid_maps               = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.use_virtio_for_bridges = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.virt_type              = kvm {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.volume_clear           = zero {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.volume_clear_size      = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.volume_use_multipath   = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.vzstorage_cache_path   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.auth_section           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.auth_type              = password {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.cafile                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.certfile               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.collect_timing         = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.connect_retries        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.connect_retry_delay    = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.default_floating_pool  = public {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.endpoint_override      = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.extension_sync_interval = 600 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.http_retries           = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.insecure               = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.keyfile                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.max_version            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.min_version            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.ovs_bridge             = br-int {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.physnets               = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.region_name            = RegionOne {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.service_metadata_proxy = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.service_name           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.service_type           = network {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.split_loggers          = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.status_code_retries    = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.status_code_retry_delay = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.timeout                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] neutron.version                = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] notifications.bdms_in_notifications = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] notifications.default_level    = INFO {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] notifications.notification_format = unversioned {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] notifications.notify_on_state_change = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] pci.alias                      = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] pci.device_spec                = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] pci.report_in_placement        = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.auth_section         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.auth_type            = password {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.cafile               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.certfile             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.collect_timing       = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.connect_retries      = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.connect_retry_delay  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.default_domain_id    = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.default_domain_name  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.domain_id            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.domain_name          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.endpoint_override    = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.insecure             = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.keyfile              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.max_version          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.min_version          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.password             = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.project_domain_id    = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.project_domain_name  = Default {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.project_id           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.project_name         = service {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.region_name          = RegionOne {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.service_name         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.service_type         = placement {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.split_loggers        = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.status_code_retries  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.status_code_retry_delay = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.system_scope         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.timeout              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.trust_id             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.user_domain_id       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.user_domain_name     = Default {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.user_id              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.username             = placement {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] placement.version              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.cores                    = 20 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.count_usage_from_placement = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.injected_file_content_bytes = 10240 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.injected_file_path_length = 255 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.injected_files           = 5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.instances                = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.key_pairs                = 100 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.metadata_items           = 128 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.ram                      = 51200 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.recheck_quota            = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.server_group_members     = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] quota.server_groups            = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] rdp.enabled                    = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler.image_metadata_prefilter = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler.max_attempts         = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler.max_placement_results = 1000 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] scheduler.workers              = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.host_subset_size = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.isolated_hosts = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.isolated_images = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.pci_in_placement = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.track_instance_changes = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] metrics.required               = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] metrics.weight_multiplier      = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] metrics.weight_setting         = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] serial_console.enabled         = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] serial_console.port_range      = 10000:20000 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] serial_console.serialproxy_port = 6083 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_user.auth_section      = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_user.auth_type         = password {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_user.cafile            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_user.certfile          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_user.collect_timing    = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_user.insecure          = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_user.keyfile           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_user.send_service_user_token = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_user.split_loggers     = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] service_user.timeout           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.agent_enabled            = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.enabled                  = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.html5proxy_port          = 6082 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.image_compression        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.jpeg_compression         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.playback_compression     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.server_listen            = 127.0.0.1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.streaming_mode           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] spice.zlib_compression         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] upgrade_levels.baseapi         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] upgrade_levels.cert            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] upgrade_levels.compute         = auto {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] upgrade_levels.conductor       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] upgrade_levels.scheduler       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vendordata_dynamic_auth.cafile = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vendordata_dynamic_auth.certfile = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vendordata_dynamic_auth.insecure = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vendordata_dynamic_auth.timeout = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.api_retry_count         = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.ca_file                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.cache_prefix            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.cluster_name            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.connection_pool_size    = 10 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.console_delay_seconds   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.datastore_regex         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.host_ip                 = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.host_password           = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.host_port               = 443 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.host_username           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.insecure                = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.integration_bridge      = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.maximum_objects         = 100 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.pbm_default_policy      = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.pbm_enabled             = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.pbm_wsdl_location       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.serial_port_proxy_uri   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.serial_port_service_uri = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.task_poll_interval      = 0.5 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.use_linked_clone        = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.vnc_keymap              = en-us {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.vnc_port                = 5900 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vmware.vnc_port_total          = 10000 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vnc.auth_schemes               = ['none'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vnc.enabled                    = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vnc.novncproxy_port            = 6080 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vnc.vencrypt_ca_certs          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vnc.vencrypt_client_cert       = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vnc.vencrypt_client_key        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.disable_rootwrap   = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.enable_numa_live_migration = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.libvirt_disable_apic = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.client_socket_timeout     = 900 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.default_pool_size         = 1000 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.keep_alive                = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.max_header_line           = 16384 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.ssl_ca_file               = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.ssl_cert_file             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.ssl_key_file              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.tcp_keepidle              = 600 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] zvm.ca_file                    = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] zvm.cloud_connector_url        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] zvm.reachable_timeout          = 300 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_policy.enforce_new_defaults = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_policy.enforce_scope      = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_policy.policy_default_rule = default {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.connection_string     = messaging:// {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.enabled               = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.es_doc_type           = notification {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.es_scroll_size        = 10000 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.es_scroll_time        = 2m {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.filter_error_trace    = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.hmac_keys             = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.sentinel_service_name = mymaster {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.socket_timeout        = 0.1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.trace_requests        = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler.trace_sqlalchemy      = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler_jaeger.process_tags   = {} {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler_jaeger.service_name_prefix = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:15 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] profiler_otlp.service_name_prefix = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] remote_debug.host              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] remote_debug.port              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_notifications.retry = -1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.auth_section        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.auth_type           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.cafile              = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.certfile            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.collect_timing      = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.connect_retries     = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.connect_retry_delay = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.endpoint_id         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.endpoint_override   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.insecure            = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.keyfile             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.max_version         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.min_version         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.region_name         = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.service_name        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.service_type        = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.split_loggers       = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.status_code_retries = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.status_code_retry_delay = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.timeout             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.valid_interfaces    = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_limit.version             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_reports.file_event_handler = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] oslo_reports.log_dir           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_ovs_privileged.group  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] vif_plug_ovs_privileged.user   = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_ovs.isolate_vif         = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] os_brick.lock_path             = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] privsep_osbrick.capabilities   = [21] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] privsep_osbrick.group          = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] privsep_osbrick.helper_command = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] privsep_osbrick.user           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] nova_sys_admin.group           = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] nova_sys_admin.helper_command  = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] nova_sys_admin.user            = None {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG oslo_service.service [None req-bb14ae93-14da-4d50-b35f-6fc37fad1914 None None] ******************************************************************************** {{(pid=75205) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 19:04:16 user nova-compute[75205]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 19:04:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Connecting to libvirt: qemu:///system {{(pid=75205) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fbb94c5b010> {{(pid=75205) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 19:04:16 user nova-compute[75205]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 19:04:16 user nova-compute[75205]: WARNING nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 19:04:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fbb94c5b010> {{(pid=75205) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Starting native event thread {{(pid=75205) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Starting green dispatch thread {{(pid=75205) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 19:04:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Starting connection event dispatch thread {{(pid=75205) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 19:04:16 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Connection event '1' reason 'None'
Nov 14 19:04:16 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 19:04:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.mount [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Initialising _HostMountState generation 0 {{(pid=75205) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 19:04:23 user nova-compute[75205]: INFO nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Libvirt host capabilities <capabilities>
Nov 14 19:04:23 user nova-compute[75205]:   <host>
Nov 14 19:04:23 user nova-compute[75205]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 19:04:23 user nova-compute[75205]:     <cpu>
Nov 14 19:04:23 user nova-compute[75205]:       <arch>x86_64</arch>
Nov 14 19:04:23 user nova-compute[75205]:       <model>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <vendor>Intel</vendor>
Nov 14 19:04:23 user nova-compute[75205]:       <microcode version='1070'/>
Nov 14 19:04:23 user nova-compute[75205]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 19:04:23 user nova-compute[75205]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='ss'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='vmx'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='pcid'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='osxsave'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='hypervisor'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='arat'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='tsc_adjust'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='md-clear'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='arch-capabilities'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='invtsc'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='rsba'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 19:04:23 user nova-compute[75205]:       <pages unit='KiB' size='4'/>
Nov 14 19:04:23 user nova-compute[75205]:       <pages unit='KiB' size='2048'/>
Nov 14 19:04:23 user nova-compute[75205]:     </cpu>
Nov 14 19:04:23 user nova-compute[75205]:     <power_management>
Nov 14 19:04:23 user nova-compute[75205]:       <suspend_mem/>
Nov 14 19:04:23 user nova-compute[75205]:       <suspend_disk/>
Nov 14 19:04:23 user nova-compute[75205]:       <suspend_hybrid/>
Nov 14 19:04:23 user nova-compute[75205]:     </power_management>
Nov 14 19:04:23 user nova-compute[75205]:     <iommu support='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     <migration_features>
Nov 14 19:04:23 user nova-compute[75205]:       <live/>
Nov 14 19:04:23 user nova-compute[75205]:       <uri_transports>
Nov 14 19:04:23 user nova-compute[75205]:         <uri_transport>tcp</uri_transport>
Nov 14 19:04:23 user nova-compute[75205]:         <uri_transport>rdma</uri_transport>
Nov 14 19:04:23 user nova-compute[75205]:       </uri_transports>
Nov 14 19:04:23 user nova-compute[75205]:     </migration_features>
Nov 14 19:04:23 user nova-compute[75205]:     <topology>
Nov 14 19:04:23 user nova-compute[75205]:       <cells num='2'>
Nov 14 19:04:23 user nova-compute[75205]:         <cell id='0'>
Nov 14 19:04:23 user nova-compute[75205]:           <memory unit='KiB'>8140616</memory>
Nov 14 19:04:23 user nova-compute[75205]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 14 19:04:23 user nova-compute[75205]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 19:04:23 user nova-compute[75205]:           <distances>
Nov 14 19:04:23 user nova-compute[75205]:             <sibling id='0' value='10'/>
Nov 14 19:04:23 user nova-compute[75205]:             <sibling id='1' value='20'/>
Nov 14 19:04:23 user nova-compute[75205]:           </distances>
Nov 14 19:04:23 user nova-compute[75205]:           <cpus num='6'>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 19:04:23 user nova-compute[75205]:           </cpus>
Nov 14 19:04:23 user nova-compute[75205]:         </cell>
Nov 14 19:04:23 user nova-compute[75205]:         <cell id='1'>
Nov 14 19:04:23 user nova-compute[75205]:           <memory unit='KiB'>8255100</memory>
Nov 14 19:04:23 user nova-compute[75205]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 14 19:04:23 user nova-compute[75205]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 19:04:23 user nova-compute[75205]:           <distances>
Nov 14 19:04:23 user nova-compute[75205]:             <sibling id='0' value='20'/>
Nov 14 19:04:23 user nova-compute[75205]:             <sibling id='1' value='10'/>
Nov 14 19:04:23 user nova-compute[75205]:           </distances>
Nov 14 19:04:23 user nova-compute[75205]:           <cpus num='6'>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 19:04:23 user nova-compute[75205]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 19:04:23 user nova-compute[75205]:           </cpus>
Nov 14 19:04:23 user nova-compute[75205]:         </cell>
Nov 14 19:04:23 user nova-compute[75205]:       </cells>
Nov 14 19:04:23 user nova-compute[75205]:     </topology>
Nov 14 19:04:23 user nova-compute[75205]:     <cache>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 19:04:23 user nova-compute[75205]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 19:04:23 user nova-compute[75205]:     </cache>
Nov 14 19:04:23 user nova-compute[75205]:     <secmodel>
Nov 14 19:04:23 user nova-compute[75205]:       <model>apparmor</model>
Nov 14 19:04:23 user nova-compute[75205]:       <doi>0</doi>
Nov 14 19:04:23 user nova-compute[75205]:     </secmodel>
Nov 14 19:04:23 user nova-compute[75205]:     <secmodel>
Nov 14 19:04:23 user nova-compute[75205]:       <model>dac</model>
Nov 14 19:04:23 user nova-compute[75205]:       <doi>0</doi>
Nov 14 19:04:23 user nova-compute[75205]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 19:04:23 user nova-compute[75205]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 19:04:23 user nova-compute[75205]:     </secmodel>
Nov 14 19:04:23 user nova-compute[75205]:   </host>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='alpha'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>clipper</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='armv6l'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>spitz</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>nuri</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>kzm</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sx1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>z2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>tosa</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>n810</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>n800</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>terrier</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>midway</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>microbit</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>verdex</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>highbank</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>akita</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>connex</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>collie</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='armv7l'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>spitz</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>nuri</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>kzm</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sx1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>z2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>tosa</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>n810</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>n800</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>terrier</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>midway</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>microbit</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>verdex</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>highbank</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>akita</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>connex</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>collie</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='aarch64'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>spitz</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>nuri</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>kzm</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sx1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>z2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>tosa</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>n810</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>n800</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>terrier</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>midway</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>microbit</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>verdex</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>highbank</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>akita</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>connex</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>collie</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <acpi default='on' toggle='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='cris'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='i686'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>isapc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>microvm</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='kvm'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <pae/>
Nov 14 19:04:23 user nova-compute[75205]:       <nonpae/>
Nov 14 19:04:23 user nova-compute[75205]:       <acpi default='on' toggle='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:       <apic default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='m68k'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>an5206</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>q800</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='microblaze'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='microblazeel'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='mips'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='16'>malta</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='mipsel'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='16'>malta</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='mips64'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='16'>malta</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>pica61</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>magnum</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='mips64el'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='16'>malta</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>pica61</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>magnum</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='16'>boston</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='ppc'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mac99</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>40p</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>taihu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='ppc64'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>taihu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>40p</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mac99</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='ppc64le'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>taihu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>40p</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>mac99</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='riscv32'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='8'>spike</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='8'>virt</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='riscv64'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='8'>spike</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='8'>virt</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='s390x'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='sh4'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>shix</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>r2d</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='sh4eb'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>shix</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>r2d</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='sparc'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>LX</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='sparc64'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>niagara</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='x86_64'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>64</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='1'>isapc</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>microvm</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='kvm'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <acpi default='on' toggle='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:       <apic default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='xtensa'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>sim</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>kc705</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>ml605</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>virt</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>lx200</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>lx60</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]:   <guest>
Nov 14 19:04:23 user nova-compute[75205]:     <os_type>hvm</os_type>
Nov 14 19:04:23 user nova-compute[75205]:     <arch name='xtensaeb'>
Nov 14 19:04:23 user nova-compute[75205]:       <wordsize>32</wordsize>
Nov 14 19:04:23 user nova-compute[75205]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='4'>sim</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>kc705</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>ml605</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>virt</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>lx200</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>lx60</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 19:04:23 user nova-compute[75205]:       <domain type='qemu'/>
Nov 14 19:04:23 user nova-compute[75205]:     </arch>
Nov 14 19:04:23 user nova-compute[75205]:     <features>
Nov 14 19:04:23 user nova-compute[75205]:       <cpuselection/>
Nov 14 19:04:23 user nova-compute[75205]:       <deviceboot/>
Nov 14 19:04:23 user nova-compute[75205]:       <disksnapshot default='on' toggle='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     </features>
Nov 14 19:04:23 user nova-compute[75205]:   </guest>
Nov 14 19:04:23 user nova-compute[75205]: </capabilities>
Nov 14 19:04:23 user nova-compute[75205]: 
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 19:04:23 user nova-compute[75205]: <domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 19:04:23 user nova-compute[75205]:   <domain>kvm</domain>
Nov 14 19:04:23 user nova-compute[75205]:   <machine>pc-i440fx-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:   <arch>i686</arch>
Nov 14 19:04:23 user nova-compute[75205]:   <vcpu max='255'/>
Nov 14 19:04:23 user nova-compute[75205]:   <iothreads supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:   <os supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='firmware'/>
Nov 14 19:04:23 user nova-compute[75205]:     <loader supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>rom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pflash</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='readonly'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>yes</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='secure'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </loader>
Nov 14 19:04:23 user nova-compute[75205]:   </os>
Nov 14 19:04:23 user nova-compute[75205]:   <cpu>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-passthrough' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='hostPassthroughMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='maximum' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='maximumMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-model' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <vendor>Intel</vendor>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ss'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='vmx'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pcid'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='hypervisor'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arat'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='umip'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='md-clear'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibpb'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibrs'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='erms'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='lm'/>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='custom' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>qemu64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>qemu32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>phenom</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>n270</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>kvm64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>coreduo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>core2duo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>athlon</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Westmere</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Snowridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Penryn</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G5</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G4</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G1</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Nehalem</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Rome</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Milan</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Dhyana</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cooperlake</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Conroe</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>486</model>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:   </cpu>
Nov 14 19:04:23 user nova-compute[75205]:   <memoryBacking supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='sourceType'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>file</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>anonymous</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>memfd</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:   </memoryBacking>
Nov 14 19:04:23 user nova-compute[75205]:   <devices>
Nov 14 19:04:23 user nova-compute[75205]:     <disk supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='diskDevice'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>disk</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cdrom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>floppy</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>lun</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='bus'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ide</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>fdc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sata</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </disk>
Nov 14 19:04:23 user nova-compute[75205]:     <graphics supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sdl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vnc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>spice</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egl-headless</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </graphics>
Nov 14 19:04:23 user nova-compute[75205]:     <video supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='modelType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cirrus</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vmvga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>qxl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>none</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>bochs</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ramfb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </video>
Nov 14 19:04:23 user nova-compute[75205]:     <hostdev supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='mode'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>subsystem</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='startupPolicy'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>default</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>mandatory</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>requisite</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>optional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='subsysType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pci</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='capsType'/>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='pciBackend'/>
Nov 14 19:04:23 user nova-compute[75205]:     </hostdev>
Nov 14 19:04:23 user nova-compute[75205]:     <rng supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>random</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egd</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>builtin</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </rng>
Nov 14 19:04:23 user nova-compute[75205]:     <filesystem supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='driverType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>path</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>handle</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtiofs</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </filesystem>
Nov 14 19:04:23 user nova-compute[75205]:     <tpm supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-tis</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-crb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>passthrough</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>emulator</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </tpm>
Nov 14 19:04:23 user nova-compute[75205]:   </devices>
Nov 14 19:04:23 user nova-compute[75205]:   <features>
Nov 14 19:04:23 user nova-compute[75205]:     <gic supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     <vmcoreinfo supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <genid supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backingStoreInput supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backup supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <sev supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:   </features>
Nov 14 19:04:23 user nova-compute[75205]: </domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:  {{(pid=75205) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 19:04:23 user nova-compute[75205]: <domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 19:04:23 user nova-compute[75205]:   <domain>kvm</domain>
Nov 14 19:04:23 user nova-compute[75205]:   <machine>pc-q35-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:   <arch>i686</arch>
Nov 14 19:04:23 user nova-compute[75205]:   <vcpu max='288'/>
Nov 14 19:04:23 user nova-compute[75205]:   <iothreads supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:   <os supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='firmware'/>
Nov 14 19:04:23 user nova-compute[75205]:     <loader supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>rom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pflash</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='readonly'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>yes</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='secure'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </loader>
Nov 14 19:04:23 user nova-compute[75205]:   </os>
Nov 14 19:04:23 user nova-compute[75205]:   <cpu>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-passthrough' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='hostPassthroughMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='maximum' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='maximumMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-model' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <vendor>Intel</vendor>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ss'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='vmx'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pcid'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='hypervisor'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arat'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='umip'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='md-clear'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibpb'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibrs'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='erms'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='lm'/>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='custom' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>qemu64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>qemu32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>phenom</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>n270</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>kvm64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>coreduo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>core2duo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>athlon</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Westmere</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Snowridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Penryn</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G5</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G4</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G1</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Nehalem</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Rome</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Milan</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Dhyana</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cooperlake</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Conroe</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>486</model>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:   </cpu>
Nov 14 19:04:23 user nova-compute[75205]:   <memoryBacking supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='sourceType'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>file</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>anonymous</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>memfd</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:   </memoryBacking>
Nov 14 19:04:23 user nova-compute[75205]:   <devices>
Nov 14 19:04:23 user nova-compute[75205]:     <disk supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='diskDevice'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>disk</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cdrom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>floppy</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>lun</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='bus'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>fdc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sata</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </disk>
Nov 14 19:04:23 user nova-compute[75205]:     <graphics supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sdl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vnc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>spice</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egl-headless</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </graphics>
Nov 14 19:04:23 user nova-compute[75205]:     <video supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='modelType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cirrus</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vmvga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>qxl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>none</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>bochs</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ramfb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </video>
Nov 14 19:04:23 user nova-compute[75205]:     <hostdev supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='mode'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>subsystem</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='startupPolicy'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>default</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>mandatory</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>requisite</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>optional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='subsysType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pci</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='capsType'/>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='pciBackend'/>
Nov 14 19:04:23 user nova-compute[75205]:     </hostdev>
Nov 14 19:04:23 user nova-compute[75205]:     <rng supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>random</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egd</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>builtin</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </rng>
Nov 14 19:04:23 user nova-compute[75205]:     <filesystem supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='driverType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>path</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>handle</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtiofs</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </filesystem>
Nov 14 19:04:23 user nova-compute[75205]:     <tpm supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-tis</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-crb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>passthrough</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>emulator</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </tpm>
Nov 14 19:04:23 user nova-compute[75205]:   </devices>
Nov 14 19:04:23 user nova-compute[75205]:   <features>
Nov 14 19:04:23 user nova-compute[75205]:     <gic supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     <vmcoreinfo supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <genid supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backingStoreInput supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backup supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <sev supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:   </features>
Nov 14 19:04:23 user nova-compute[75205]: </domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:  {{(pid=75205) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 19:04:23 user nova-compute[75205]: <domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 19:04:23 user nova-compute[75205]:   <domain>kvm</domain>
Nov 14 19:04:23 user nova-compute[75205]:   <machine>pc-q35-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:   <arch>i686</arch>
Nov 14 19:04:23 user nova-compute[75205]:   <vcpu max='288'/>
Nov 14 19:04:23 user nova-compute[75205]:   <iothreads supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:   <os supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='firmware'/>
Nov 14 19:04:23 user nova-compute[75205]:     <loader supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>rom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pflash</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='readonly'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>yes</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='secure'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </loader>
Nov 14 19:04:23 user nova-compute[75205]:   </os>
Nov 14 19:04:23 user nova-compute[75205]:   <cpu>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-passthrough' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='hostPassthroughMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='maximum' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='maximumMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-model' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <vendor>Intel</vendor>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ss'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='vmx'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pcid'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='hypervisor'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arat'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='umip'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='md-clear'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibpb'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibrs'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='erms'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='lm'/>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='custom' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>qemu64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>qemu32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>phenom</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>n270</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>kvm64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>coreduo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>core2duo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>athlon</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Westmere</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Snowridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Penryn</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G5</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G4</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G1</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Nehalem</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Rome</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Milan</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Dhyana</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cooperlake</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Conroe</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>486</model>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:   </cpu>
Nov 14 19:04:23 user nova-compute[75205]:   <memoryBacking supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='sourceType'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>file</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>anonymous</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>memfd</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:   </memoryBacking>
Nov 14 19:04:23 user nova-compute[75205]:   <devices>
Nov 14 19:04:23 user nova-compute[75205]:     <disk supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='diskDevice'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>disk</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cdrom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>floppy</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>lun</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='bus'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>fdc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sata</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </disk>
Nov 14 19:04:23 user nova-compute[75205]:     <graphics supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sdl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vnc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>spice</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egl-headless</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </graphics>
Nov 14 19:04:23 user nova-compute[75205]:     <video supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='modelType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cirrus</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vmvga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>qxl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>none</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>bochs</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ramfb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </video>
Nov 14 19:04:23 user nova-compute[75205]:     <hostdev supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='mode'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>subsystem</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='startupPolicy'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>default</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>mandatory</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>requisite</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>optional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='subsysType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pci</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='capsType'/>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='pciBackend'/>
Nov 14 19:04:23 user nova-compute[75205]:     </hostdev>
Nov 14 19:04:23 user nova-compute[75205]:     <rng supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>random</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egd</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>builtin</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </rng>
Nov 14 19:04:23 user nova-compute[75205]:     <filesystem supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='driverType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>path</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>handle</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtiofs</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </filesystem>
Nov 14 19:04:23 user nova-compute[75205]:     <tpm supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-tis</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-crb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>passthrough</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>emulator</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </tpm>
Nov 14 19:04:23 user nova-compute[75205]:   </devices>
Nov 14 19:04:23 user nova-compute[75205]:   <features>
Nov 14 19:04:23 user nova-compute[75205]:     <gic supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     <vmcoreinfo supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <genid supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backingStoreInput supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backup supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <sev supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:   </features>
Nov 14 19:04:23 user nova-compute[75205]: </domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:  {{(pid=75205) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 19:04:23 user nova-compute[75205]: <domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 19:04:23 user nova-compute[75205]:   <domain>kvm</domain>
Nov 14 19:04:23 user nova-compute[75205]:   <machine>pc-i440fx-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:   <arch>i686</arch>
Nov 14 19:04:23 user nova-compute[75205]:   <vcpu max='255'/>
Nov 14 19:04:23 user nova-compute[75205]:   <iothreads supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:   <os supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='firmware'/>
Nov 14 19:04:23 user nova-compute[75205]:     <loader supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>rom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pflash</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='readonly'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>yes</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='secure'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </loader>
Nov 14 19:04:23 user nova-compute[75205]:   </os>
Nov 14 19:04:23 user nova-compute[75205]:   <cpu>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-passthrough' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='hostPassthroughMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='maximum' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='maximumMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-model' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <vendor>Intel</vendor>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ss'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='vmx'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pcid'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='hypervisor'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arat'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='umip'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='md-clear'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibpb'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibrs'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='erms'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='lm'/>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='custom' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>qemu64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>qemu32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>phenom</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>n270</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>kvm64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>coreduo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>core2duo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>athlon</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Westmere</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Snowridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Penryn</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G5</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G4</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G1</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Nehalem</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Rome</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Milan</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Dhyana</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cooperlake</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Conroe</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>486</model>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:   </cpu>
Nov 14 19:04:23 user nova-compute[75205]:   <memoryBacking supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='sourceType'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>file</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>anonymous</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>memfd</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:   </memoryBacking>
Nov 14 19:04:23 user nova-compute[75205]:   <devices>
Nov 14 19:04:23 user nova-compute[75205]:     <disk supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='diskDevice'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>disk</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cdrom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>floppy</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>lun</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='bus'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ide</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>fdc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sata</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </disk>
Nov 14 19:04:23 user nova-compute[75205]:     <graphics supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sdl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vnc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>spice</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egl-headless</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </graphics>
Nov 14 19:04:23 user nova-compute[75205]:     <video supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='modelType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cirrus</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vmvga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>qxl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>none</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>bochs</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ramfb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </video>
Nov 14 19:04:23 user nova-compute[75205]:     <hostdev supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='mode'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>subsystem</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='startupPolicy'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>default</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>mandatory</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>requisite</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>optional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='subsysType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pci</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='capsType'/>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='pciBackend'/>
Nov 14 19:04:23 user nova-compute[75205]:     </hostdev>
Nov 14 19:04:23 user nova-compute[75205]:     <rng supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>random</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egd</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>builtin</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </rng>
Nov 14 19:04:23 user nova-compute[75205]:     <filesystem supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='driverType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>path</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>handle</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtiofs</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </filesystem>
Nov 14 19:04:23 user nova-compute[75205]:     <tpm supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-tis</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-crb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>passthrough</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>emulator</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </tpm>
Nov 14 19:04:23 user nova-compute[75205]:   </devices>
Nov 14 19:04:23 user nova-compute[75205]:   <features>
Nov 14 19:04:23 user nova-compute[75205]:     <gic supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     <vmcoreinfo supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <genid supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backingStoreInput supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backup supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <sev supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:   </features>
Nov 14 19:04:23 user nova-compute[75205]: </domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:  {{(pid=75205) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 19:04:23 user nova-compute[75205]: <domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 19:04:23 user nova-compute[75205]:   <domain>kvm</domain>
Nov 14 19:04:23 user nova-compute[75205]:   <machine>pc-i440fx-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:   <arch>x86_64</arch>
Nov 14 19:04:23 user nova-compute[75205]:   <vcpu max='255'/>
Nov 14 19:04:23 user nova-compute[75205]:   <iothreads supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:   <os supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='firmware'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>efi</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:     <loader supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>rom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pflash</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='readonly'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>yes</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='secure'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </loader>
Nov 14 19:04:23 user nova-compute[75205]:   </os>
Nov 14 19:04:23 user nova-compute[75205]:   <cpu>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-passthrough' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='hostPassthroughMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='maximum' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='maximumMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-model' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <vendor>Intel</vendor>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ss'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='vmx'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pcid'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='hypervisor'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arat'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='umip'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='md-clear'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='invtsc'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibpb'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibrs'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='rsba'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='erms'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='custom' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>qemu64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>qemu32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>phenom</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>n270</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>coreduo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>core2duo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>athlon</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Westmere</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Snowridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Penryn</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G5</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G4</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Opteron_G1</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Nehalem</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Rome</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Milan</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Dhyana</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cooperlake</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Conroe</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>486</model>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:   </cpu>
Nov 14 19:04:23 user nova-compute[75205]:   <memoryBacking supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='sourceType'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>file</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>anonymous</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>memfd</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:   </memoryBacking>
Nov 14 19:04:23 user nova-compute[75205]:   <devices>
Nov 14 19:04:23 user nova-compute[75205]:     <disk supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='diskDevice'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>disk</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cdrom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>floppy</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>lun</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='bus'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ide</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>fdc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sata</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </disk>
Nov 14 19:04:23 user nova-compute[75205]:     <graphics supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sdl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vnc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>spice</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egl-headless</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </graphics>
Nov 14 19:04:23 user nova-compute[75205]:     <video supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='modelType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cirrus</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vmvga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>qxl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>none</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>bochs</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ramfb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </video>
Nov 14 19:04:23 user nova-compute[75205]:     <hostdev supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='mode'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>subsystem</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='startupPolicy'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>default</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>mandatory</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>requisite</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>optional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='subsysType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pci</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='capsType'/>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='pciBackend'/>
Nov 14 19:04:23 user nova-compute[75205]:     </hostdev>
Nov 14 19:04:23 user nova-compute[75205]:     <rng supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>random</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egd</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>builtin</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </rng>
Nov 14 19:04:23 user nova-compute[75205]:     <filesystem supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='driverType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>path</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>handle</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtiofs</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </filesystem>
Nov 14 19:04:23 user nova-compute[75205]:     <tpm supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-tis</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-crb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>passthrough</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>emulator</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </tpm>
Nov 14 19:04:23 user nova-compute[75205]:   </devices>
Nov 14 19:04:23 user nova-compute[75205]:   <features>
Nov 14 19:04:23 user nova-compute[75205]:     <gic supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     <vmcoreinfo supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <genid supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backingStoreInput supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backup supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <sev supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:   </features>
Nov 14 19:04:23 user nova-compute[75205]: </domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:  {{(pid=75205) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 19:04:23 user nova-compute[75205]: <domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 19:04:23 user nova-compute[75205]:   <domain>kvm</domain>
Nov 14 19:04:23 user nova-compute[75205]:   <machine>pc-q35-jammy</machine>
Nov 14 19:04:23 user nova-compute[75205]:   <arch>x86_64</arch>
Nov 14 19:04:23 user nova-compute[75205]:   <vcpu max='288'/>
Nov 14 19:04:23 user nova-compute[75205]:   <iothreads supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:   <os supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='firmware'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>efi</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:     <loader supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>rom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pflash</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='readonly'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>yes</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='secure'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>yes</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </loader>
Nov 14 19:04:23 user nova-compute[75205]:   </os>
Nov 14 19:04:23 user nova-compute[75205]:   <cpu>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-passthrough' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='hostPassthroughMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='maximum' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='maximumMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-model' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <vendor>Intel</vendor>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ss'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='vmx'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pcid'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='hypervisor'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arat'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='umip'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='md-clear'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='invtsc'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibpb'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibrs'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='rsba'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='erms'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='custom' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>qemu64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>qemu32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>phenom</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>n270</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>coreduo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>core2duo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>athlon</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Westmere</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Snowridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Penryn</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G5</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G4</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Opteron_G1</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Nehalem</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Rome</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Milan</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Dhyana</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cooperlake</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Conroe</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>486</model>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:   </cpu>
Nov 14 19:04:23 user nova-compute[75205]:   <memoryBacking supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='sourceType'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>file</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>anonymous</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>memfd</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:   </memoryBacking>
Nov 14 19:04:23 user nova-compute[75205]:   <devices>
Nov 14 19:04:23 user nova-compute[75205]:     <disk supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='diskDevice'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>disk</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cdrom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>floppy</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>lun</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='bus'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>fdc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sata</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </disk>
Nov 14 19:04:23 user nova-compute[75205]:     <graphics supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sdl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vnc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>spice</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egl-headless</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </graphics>
Nov 14 19:04:23 user nova-compute[75205]:     <video supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='modelType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cirrus</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vmvga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>qxl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>none</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>bochs</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ramfb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </video>
Nov 14 19:04:23 user nova-compute[75205]:     <hostdev supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='mode'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>subsystem</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='startupPolicy'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>default</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>mandatory</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>requisite</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>optional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='subsysType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pci</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='capsType'/>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='pciBackend'/>
Nov 14 19:04:23 user nova-compute[75205]:     </hostdev>
Nov 14 19:04:23 user nova-compute[75205]:     <rng supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>random</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egd</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>builtin</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </rng>
Nov 14 19:04:23 user nova-compute[75205]:     <filesystem supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='driverType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>path</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>handle</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtiofs</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </filesystem>
Nov 14 19:04:23 user nova-compute[75205]:     <tpm supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-tis</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-crb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>passthrough</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>emulator</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </tpm>
Nov 14 19:04:23 user nova-compute[75205]:   </devices>
Nov 14 19:04:23 user nova-compute[75205]:   <features>
Nov 14 19:04:23 user nova-compute[75205]:     <gic supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     <vmcoreinfo supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <genid supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backingStoreInput supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backup supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <sev supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:   </features>
Nov 14 19:04:23 user nova-compute[75205]: </domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:  {{(pid=75205) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 19:04:23 user nova-compute[75205]: <domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 19:04:23 user nova-compute[75205]:   <domain>kvm</domain>
Nov 14 19:04:23 user nova-compute[75205]:   <machine>pc-q35-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:   <arch>x86_64</arch>
Nov 14 19:04:23 user nova-compute[75205]:   <vcpu max='288'/>
Nov 14 19:04:23 user nova-compute[75205]:   <iothreads supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:   <os supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='firmware'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>efi</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:     <loader supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>rom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pflash</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='readonly'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>yes</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='secure'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>yes</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </loader>
Nov 14 19:04:23 user nova-compute[75205]:   </os>
Nov 14 19:04:23 user nova-compute[75205]:   <cpu>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-passthrough' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='hostPassthroughMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='maximum' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='maximumMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-model' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <vendor>Intel</vendor>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ss'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='vmx'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pcid'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='hypervisor'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arat'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='umip'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='md-clear'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='invtsc'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibpb'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibrs'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='rsba'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='erms'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='custom' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>qemu64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>qemu32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>phenom</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>n270</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>coreduo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>core2duo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>athlon</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Westmere</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Snowridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Penryn</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G5</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G4</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Opteron_G1</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Nehalem</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Rome</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Milan</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Dhyana</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cooperlake</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Conroe</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>486</model>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:   </cpu>
Nov 14 19:04:23 user nova-compute[75205]:   <memoryBacking supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='sourceType'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>file</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>anonymous</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>memfd</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:   </memoryBacking>
Nov 14 19:04:23 user nova-compute[75205]:   <devices>
Nov 14 19:04:23 user nova-compute[75205]:     <disk supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='diskDevice'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>disk</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cdrom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>floppy</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>lun</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='bus'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>fdc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sata</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </disk>
Nov 14 19:04:23 user nova-compute[75205]:     <graphics supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sdl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vnc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>spice</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egl-headless</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </graphics>
Nov 14 19:04:23 user nova-compute[75205]:     <video supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='modelType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cirrus</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vmvga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>qxl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>none</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>bochs</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ramfb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </video>
Nov 14 19:04:23 user nova-compute[75205]:     <hostdev supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='mode'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>subsystem</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='startupPolicy'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>default</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>mandatory</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>requisite</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>optional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='subsysType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pci</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='capsType'/>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='pciBackend'/>
Nov 14 19:04:23 user nova-compute[75205]:     </hostdev>
Nov 14 19:04:23 user nova-compute[75205]:     <rng supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>random</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egd</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>builtin</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </rng>
Nov 14 19:04:23 user nova-compute[75205]:     <filesystem supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='driverType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>path</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>handle</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtiofs</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </filesystem>
Nov 14 19:04:23 user nova-compute[75205]:     <tpm supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-tis</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-crb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>passthrough</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>emulator</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </tpm>
Nov 14 19:04:23 user nova-compute[75205]:   </devices>
Nov 14 19:04:23 user nova-compute[75205]:   <features>
Nov 14 19:04:23 user nova-compute[75205]:     <gic supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     <vmcoreinfo supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <genid supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backingStoreInput supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backup supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <sev supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:   </features>
Nov 14 19:04:23 user nova-compute[75205]: </domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:  {{(pid=75205) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 19:04:23 user nova-compute[75205]: <domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 19:04:23 user nova-compute[75205]:   <domain>kvm</domain>
Nov 14 19:04:23 user nova-compute[75205]:   <machine>pc-i440fx-6.2</machine>
Nov 14 19:04:23 user nova-compute[75205]:   <arch>x86_64</arch>
Nov 14 19:04:23 user nova-compute[75205]:   <vcpu max='255'/>
Nov 14 19:04:23 user nova-compute[75205]:   <iothreads supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:   <os supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='firmware'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>efi</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:     <loader supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>rom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pflash</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='readonly'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>yes</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='secure'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>no</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </loader>
Nov 14 19:04:23 user nova-compute[75205]:   </os>
Nov 14 19:04:23 user nova-compute[75205]:   <cpu>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-passthrough' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='hostPassthroughMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='maximum' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='maximumMigratable'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>on</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>off</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='host-model' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <vendor>Intel</vendor>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ss'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='vmx'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pcid'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='hypervisor'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arat'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='umip'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='md-clear'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='invtsc'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibpb'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='ibrs'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-stibp'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='rsba'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='erms'/>
Nov 14 19:04:23 user nova-compute[75205]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:     <mode name='custom' supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>qemu64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>qemu32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>phenom</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>pentium</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>n270</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm64</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>kvm32</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>coreduo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>core2duo</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>athlon</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Westmere</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Snowridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Skylake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>SandyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Penryn</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G5</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G4</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G3</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Opteron_G2</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Opteron_G1</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Nehalem</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>IvyBridge</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Icelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Haswell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Rome</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-Milan</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>EPYC</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Dhyana</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cooperlake</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>Conroe</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='no'>Broadwell</model>
Nov 14 19:04:23 user nova-compute[75205]:       <model usable='yes'>486</model>
Nov 14 19:04:23 user nova-compute[75205]:     </mode>
Nov 14 19:04:23 user nova-compute[75205]:   </cpu>
Nov 14 19:04:23 user nova-compute[75205]:   <memoryBacking supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:     <enum name='sourceType'>
Nov 14 19:04:23 user nova-compute[75205]:       <value>file</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>anonymous</value>
Nov 14 19:04:23 user nova-compute[75205]:       <value>memfd</value>
Nov 14 19:04:23 user nova-compute[75205]:     </enum>
Nov 14 19:04:23 user nova-compute[75205]:   </memoryBacking>
Nov 14 19:04:23 user nova-compute[75205]:   <devices>
Nov 14 19:04:23 user nova-compute[75205]:     <disk supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='diskDevice'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>disk</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cdrom</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>floppy</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>lun</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='bus'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ide</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>fdc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sata</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </disk>
Nov 14 19:04:23 user nova-compute[75205]:     <graphics supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='type'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>sdl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vnc</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>spice</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egl-headless</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </graphics>
Nov 14 19:04:23 user nova-compute[75205]:     <video supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='modelType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>cirrus</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>vmvga</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>qxl</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>none</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>bochs</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>ramfb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </video>
Nov 14 19:04:23 user nova-compute[75205]:     <hostdev supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='mode'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>subsystem</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='startupPolicy'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>default</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>mandatory</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>requisite</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>optional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='subsysType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>usb</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>pci</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>scsi</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='capsType'/>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='pciBackend'/>
Nov 14 19:04:23 user nova-compute[75205]:     </hostdev>
Nov 14 19:04:23 user nova-compute[75205]:     <rng supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtio-non-transitional</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>random</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>egd</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>builtin</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </rng>
Nov 14 19:04:23 user nova-compute[75205]:     <filesystem supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='driverType'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>path</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>handle</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>virtiofs</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </filesystem>
Nov 14 19:04:23 user nova-compute[75205]:     <tpm supported='yes'>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='model'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-tis</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>tpm-crb</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:       <enum name='backendModel'>
Nov 14 19:04:23 user nova-compute[75205]:         <value>passthrough</value>
Nov 14 19:04:23 user nova-compute[75205]:         <value>emulator</value>
Nov 14 19:04:23 user nova-compute[75205]:       </enum>
Nov 14 19:04:23 user nova-compute[75205]:     </tpm>
Nov 14 19:04:23 user nova-compute[75205]:   </devices>
Nov 14 19:04:23 user nova-compute[75205]:   <features>
Nov 14 19:04:23 user nova-compute[75205]:     <gic supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:     <vmcoreinfo supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <genid supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backingStoreInput supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <backup supported='yes'/>
Nov 14 19:04:23 user nova-compute[75205]:     <sev supported='no'/>
Nov 14 19:04:23 user nova-compute[75205]:   </features>
Nov 14 19:04:23 user nova-compute[75205]: </domainCapabilities>
Nov 14 19:04:23 user nova-compute[75205]:  {{(pid=75205) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75205) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75205) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Checking secure boot support for host arch (x86_64) {{(pid=75205) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Checking secure boot support for host arch (x86_64) {{(pid=75205) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Checking secure boot support for host arch (x86_64) {{(pid=75205) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 19:04:23 user nova-compute[75205]: INFO nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Secure Boot support detected
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] cpu compare xml: <cpu match="exact">
Nov 14 19:04:23 user nova-compute[75205]:   <model>Nehalem</model>
Nov 14 19:04:23 user nova-compute[75205]: </cpu>
Nov 14 19:04:23 user nova-compute[75205]:  {{(pid=75205) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 19:04:23 user nova-compute[75205]: INFO nova.virt.node [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Generated node identity 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8
Nov 14 19:04:23 user nova-compute[75205]: INFO nova.virt.node [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Wrote node identity 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 to /opt/stack/data/nova/compute_id
Nov 14 19:04:23 user nova-compute[75205]: WARNING nova.compute.manager [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Compute nodes ['7def1607-b7d5-4fc6-9f9d-da4f8e437fa8'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 19:04:23 user nova-compute[75205]: INFO nova.compute.manager [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 19:04:23 user nova-compute[75205]: WARNING nova.compute.manager [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 19:04:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:04:23 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:04:23 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Hypervisor/Node resource view: name=user free_ram=10933MB free_disk=26.14969253540039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:04:23 user nova-compute[75205]: WARNING nova.compute.resource_tracker [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] No compute node record for user:7def1607-b7d5-4fc6-9f9d-da4f8e437fa8: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 could not be found.
Nov 14 19:04:23 user nova-compute[75205]: INFO nova.compute.resource_tracker [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Compute node record created for user:user with uuid: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:04:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:04:24 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] [req-22d5fe08-916e-4c46-a030-05e8dff3dd56] Created resource provider record via placement API for resource provider with UUID 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 and name user.
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75205) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 19:04:24 user nova-compute[75205]: INFO nova.virt.libvirt.host [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] kernel doesn't support AMD SEV
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Libvirt baseline CPU <cpu>
Nov 14 19:04:24 user nova-compute[75205]:   <arch>x86_64</arch>
Nov 14 19:04:24 user nova-compute[75205]:   <model>Nehalem</model>
Nov 14 19:04:24 user nova-compute[75205]:   <vendor>Intel</vendor>
Nov 14 19:04:24 user nova-compute[75205]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 19:04:24 user nova-compute[75205]: </cpu>
Nov 14 19:04:24 user nova-compute[75205]:  {{(pid=75205) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Updated inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Updating resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 generation from 0 to 1 during operation: update_inventory {{(pid=75205) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Updating resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 generation from 1 to 2 during operation: update_traits {{(pid=75205) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.service [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Creating RPC server for service compute {{(pid=75205) start /opt/stack/nova/nova/service.py:182}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.service [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] Join ServiceGroup membership for this service compute {{(pid=75205) start /opt/stack/nova/nova/service.py:199}}
Nov 14 19:04:24 user nova-compute[75205]: DEBUG nova.servicegroup.drivers.db [None req-2baa28e9-08d3-4bd2-b890-f553f43dff60 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75205) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 19:04:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:04:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:05:15 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:05:15 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=10348MB free_disk=26.053489685058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:05:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:06:15 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:06:16 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:06:16 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:06:16 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=10292MB free_disk=26.117874145507812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:06:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:06:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:06:16 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:06:16 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:06:16 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:06:16 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:06:16 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:06:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:06:16 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:06:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:07:16 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:07:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:07:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:07:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:07:16 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:07:17 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:07:17 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:07:17 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=10312MB free_disk=25.870323181152344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:07:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:07:18 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:16 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:08:17 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:17 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:17 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=9589MB free_disk=25.89006805419922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:08:17 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:08:18 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:08:18 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:08:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:19 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:19 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:19 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "f185f08b-ea86-40f4-af2b-95badfddca27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "f185f08b-ea86-40f4-af2b-95badfddca27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:08:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:19 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:19 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:08:19 user nova-compute[75205]: INFO nova.compute.claims [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Claim successful on node user
Nov 14 19:08:19 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG nova.network.neutron [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:08:20 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:08:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:08:20 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Creating image(s)
Nov 14 19:08:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "/opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "/opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "/opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:08:20 user nova-compute[75205]: DEBUG nova.policy [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '280535afeca94ec2919ecfa36a9e26b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae966ad209f94612b452b66061acef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de.part --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "6e3657fa-d795-4732-852a-158c68452387" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "6e3657fa-d795-4732-852a-158c68452387" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:08:21 user nova-compute[75205]: INFO nova.compute.claims [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Claim successful on node user
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG nova.virt.images [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] 992ee33c-41f8-4ea7-bc15-8d73f5a51f6d was qcow2, converting to raw {{(pid=75205) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de.part /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de.converted {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de.part /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de.converted" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de.converted --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.456s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:21 user nova-compute[75205]: INFO oslo.privsep.daemon [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphcrvqahc/privsep.sock']
Nov 14 19:08:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:08:21 user sudo[84487]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphcrvqahc/privsep.sock
Nov 14 19:08:21 user sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 19:08:21 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:08:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:08:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:08:22 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Creating image(s)
Nov 14 19:08:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "/opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "/opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:22 user nova-compute[75205]: DEBUG nova.policy [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0ee9d2093e64175b45b3b4d99b5648f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde587867310451cab4f464b330555af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:08:22 user nova-compute[75205]: DEBUG nova.network.neutron [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Successfully created port: 48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:08:23 user sudo[84487]: pam_unix(sudo:session): session closed for user root
Nov 14 19:08:23 user nova-compute[75205]: INFO oslo.privsep.daemon [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Spawned new privsep daemon via rootwrap
Nov 14 19:08:23 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 19:08:23 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 19:08:23 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 19:08:23 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84498
Nov 14 19:08:23 user nova-compute[75205]: WARNING oslo_privsep.priv_context [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] privsep daemon already running
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk 1073741824" returned: 0 in 0.037s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Successfully created port: 33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.217s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk 1073741824" returned: 0 in 0.051s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Cannot resize image /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Ensure instance console log exists: /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Cannot resize image /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Ensure instance console log exists: /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Successfully updated port: 48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "refresh_cache-f185f08b-ea86-40f4-af2b-95badfddca27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquired lock "refresh_cache-f185f08b-ea86-40f4-af2b-95badfddca27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Successfully updated port: 33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquired lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-be27b436-6a2b-4100-b431-dc03d9eec5ef req-82836c88-0a41-430b-91a3-ba08f9aa8afc service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Received event network-changed-48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-be27b436-6a2b-4100-b431-dc03d9eec5ef req-82836c88-0a41-430b-91a3-ba08f9aa8afc service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Refreshing instance network info cache due to event network-changed-48790b5c-36b5-4f62-917c-7d6895779497. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-be27b436-6a2b-4100-b431-dc03d9eec5ef req-82836c88-0a41-430b-91a3-ba08f9aa8afc service nova] Acquiring lock "refresh_cache-f185f08b-ea86-40f4-af2b-95badfddca27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-4ef559b6-27a7-4504-93cd-05e46719549b req-cb3c7bc2-9028-46aa-a577-042409268c76 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Received event network-changed-33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-4ef559b6-27a7-4504-93cd-05e46719549b req-cb3c7bc2-9028-46aa-a577-042409268c76 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Refreshing instance network info cache due to event network-changed-33605006-0418-423d-b2f9-f7ac03767374. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4ef559b6-27a7-4504-93cd-05e46719549b req-cb3c7bc2-9028-46aa-a577-042409268c76 service nova] Acquiring lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updating instance_info_cache with network_info: [{"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Releasing lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Instance network_info: |[{"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4ef559b6-27a7-4504-93cd-05e46719549b req-cb3c7bc2-9028-46aa-a577-042409268c76 service nova] Acquired lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-4ef559b6-27a7-4504-93cd-05e46719549b req-cb3c7bc2-9028-46aa-a577-042409268c76 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Refreshing network info cache for port 33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Start _get_guest_xml network_info=[{"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:08:26 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:26 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-84222374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-84222374',id=2,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-wtn1v6pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:22Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=6e3657fa-d795-4732-852a-158c68452387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=33605006-0418-423d-b2f9-f7ac03767374,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33605006-04') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e3657fa-d795-4732-852a-158c68452387 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.neutron [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Updating instance_info_cache with network_info: [{"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:08:26 user nova-compute[75205]:   <uuid>6e3657fa-d795-4732-852a-158c68452387</uuid>
Nov 14 19:08:26 user nova-compute[75205]:   <name>instance-00000002</name>
Nov 14 19:08:26 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:08:26 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:08:26 user nova-compute[75205]:   <metadata>
Nov 14 19:08:26 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:08:26 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-84222374</nova:name>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:08:26</nova:creationTime>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:08:26 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:08:26 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:owner>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:user uuid="d0ee9d2093e64175b45b3b4d99b5648f">tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member</nova:user>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:project uuid="fde587867310451cab4f464b330555af">tempest-ServerBootFromVolumeStableRescueTest-2146587572</nova:project>
Nov 14 19:08:26 user nova-compute[75205]:       </nova:owner>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:ports>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:port uuid="33605006-0418-423d-b2f9-f7ac03767374">
Nov 14 19:08:26 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 19:08:26 user nova-compute[75205]:         </nova:port>
Nov 14 19:08:26 user nova-compute[75205]:       </nova:ports>
Nov 14 19:08:26 user nova-compute[75205]:     </nova:instance>
Nov 14 19:08:26 user nova-compute[75205]:   </metadata>
Nov 14 19:08:26 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:08:26 user nova-compute[75205]:     <system>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="serial">6e3657fa-d795-4732-852a-158c68452387</entry>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="uuid">6e3657fa-d795-4732-852a-158c68452387</entry>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:08:26 user nova-compute[75205]:     </system>
Nov 14 19:08:26 user nova-compute[75205]:   </sysinfo>
Nov 14 19:08:26 user nova-compute[75205]:   <os>
Nov 14 19:08:26 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:08:26 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:08:26 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:08:26 user nova-compute[75205]:   </os>
Nov 14 19:08:26 user nova-compute[75205]:   <features>
Nov 14 19:08:26 user nova-compute[75205]:     <acpi/>
Nov 14 19:08:26 user nova-compute[75205]:     <apic/>
Nov 14 19:08:26 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:08:26 user nova-compute[75205]:   </features>
Nov 14 19:08:26 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:08:26 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:08:26 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:08:26 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:08:26 user nova-compute[75205]:   </clock>
Nov 14 19:08:26 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:08:26 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:08:26 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:08:26 user nova-compute[75205]:   </cpu>
Nov 14 19:08:26 user nova-compute[75205]:   <devices>
Nov 14 19:08:26 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:08:26 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:08:26 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk"/>
Nov 14 19:08:26 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:08:26 user nova-compute[75205]:     </disk>
Nov 14 19:08:26 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:08:26 user nova-compute[75205]:       <mac address="fa:16:3e:f9:d2:85"/>
Nov 14 19:08:26 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:26 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:08:26 user nova-compute[75205]:       <target dev="tap33605006-04"/>
Nov 14 19:08:26 user nova-compute[75205]:     </interface>
Nov 14 19:08:26 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:08:26 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/console.log" append="off"/>
Nov 14 19:08:26 user nova-compute[75205]:     </serial>
Nov 14 19:08:26 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:08:26 user nova-compute[75205]:     <video>
Nov 14 19:08:26 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:26 user nova-compute[75205]:     </video>
Nov 14 19:08:26 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:08:26 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:08:26 user nova-compute[75205]:     </rng>
Nov 14 19:08:26 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:08:26 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:08:26 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:08:26 user nova-compute[75205]:     </memballoon>
Nov 14 19:08:26 user nova-compute[75205]:   </devices>
Nov 14 19:08:26 user nova-compute[75205]: </domain>
Nov 14 19:08:26 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-84222374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-84222374',id=2,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-wtn1v6pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:22Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=6e3657fa-d795-4732-852a-158c68452387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=33605006-0418-423d-b2f9-f7ac03767374,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33605006-04') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG os_vif [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=33605006-0418-423d-b2f9-f7ac03767374,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33605006-04') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Releasing lock "refresh_cache-f185f08b-ea86-40f4-af2b-95badfddca27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Instance network_info: |[{"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Created schema index Interface.name {{(pid=75205) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Created schema index Port.name {{(pid=75205) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Created schema index Bridge.name {{(pid=75205) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-be27b436-6a2b-4100-b431-dc03d9eec5ef req-82836c88-0a41-430b-91a3-ba08f9aa8afc service nova] Acquired lock "refresh_cache-f185f08b-ea86-40f4-af2b-95badfddca27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-be27b436-6a2b-4100-b431-dc03d9eec5ef req-82836c88-0a41-430b-91a3-ba08f9aa8afc service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Refreshing network info cache for port 48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Start _get_guest_xml network_info=[{"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [POLLOUT] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:08:26 user nova-compute[75205]: INFO nova.compute.claims [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Claim successful on node user
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46695fb8-268e-5f90-b4a2-f3f92bff3645', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:26 user nova-compute[75205]: INFO oslo.privsep.daemon [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpyg8ex51t/privsep.sock']
Nov 14 19:08:26 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:26 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:08:26 user sudo[84537]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpyg8ex51t/privsep.sock
Nov 14 19:08:26 user sudo[84537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1320716125',display_name='tempest-DeleteServersTestJSON-server-1320716125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1320716125',id=1,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae966ad209f94612b452b66061acef49',ramdisk_id='',reservation_id='r-yth6p5ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2128794415',owner_user_name='tempest-DeleteServersTestJSON-2128794415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:20Z,user_data=None,user_id='280535afeca94ec2919ecfa36a9e26b7',uuid=f185f08b-ea86-40f4-af2b-95badfddca27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Converting VIF {"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:63:ad,bridge_name='br-int',has_traffic_filtering=True,id=48790b5c-36b5-4f62-917c-7d6895779497,network=Network(45abb6e8-1123-46aa-ae2f-ebd635826ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48790b5c-36') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.objects.instance [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lazy-loading 'pci_devices' on Instance uuid f185f08b-ea86-40f4-af2b-95badfddca27 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:08:26 user nova-compute[75205]:   <uuid>f185f08b-ea86-40f4-af2b-95badfddca27</uuid>
Nov 14 19:08:26 user nova-compute[75205]:   <name>instance-00000001</name>
Nov 14 19:08:26 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:08:26 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:08:26 user nova-compute[75205]:   <metadata>
Nov 14 19:08:26 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:08:26 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:name>tempest-DeleteServersTestJSON-server-1320716125</nova:name>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:08:26</nova:creationTime>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:08:26 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:08:26 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:owner>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:user uuid="280535afeca94ec2919ecfa36a9e26b7">tempest-DeleteServersTestJSON-2128794415-project-member</nova:user>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:project uuid="ae966ad209f94612b452b66061acef49">tempest-DeleteServersTestJSON-2128794415</nova:project>
Nov 14 19:08:26 user nova-compute[75205]:       </nova:owner>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:08:26 user nova-compute[75205]:       <nova:ports>
Nov 14 19:08:26 user nova-compute[75205]:         <nova:port uuid="48790b5c-36b5-4f62-917c-7d6895779497">
Nov 14 19:08:26 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 19:08:26 user nova-compute[75205]:         </nova:port>
Nov 14 19:08:26 user nova-compute[75205]:       </nova:ports>
Nov 14 19:08:26 user nova-compute[75205]:     </nova:instance>
Nov 14 19:08:26 user nova-compute[75205]:   </metadata>
Nov 14 19:08:26 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:08:26 user nova-compute[75205]:     <system>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="serial">f185f08b-ea86-40f4-af2b-95badfddca27</entry>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="uuid">f185f08b-ea86-40f4-af2b-95badfddca27</entry>
Nov 14 19:08:26 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:08:26 user nova-compute[75205]:     </system>
Nov 14 19:08:26 user nova-compute[75205]:   </sysinfo>
Nov 14 19:08:26 user nova-compute[75205]:   <os>
Nov 14 19:08:26 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:08:26 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:08:26 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:08:26 user nova-compute[75205]:   </os>
Nov 14 19:08:26 user nova-compute[75205]:   <features>
Nov 14 19:08:26 user nova-compute[75205]:     <acpi/>
Nov 14 19:08:26 user nova-compute[75205]:     <apic/>
Nov 14 19:08:26 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:08:26 user nova-compute[75205]:   </features>
Nov 14 19:08:26 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:08:26 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:08:26 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:08:26 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:08:26 user nova-compute[75205]:   </clock>
Nov 14 19:08:26 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:08:26 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:08:26 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:08:26 user nova-compute[75205]:   </cpu>
Nov 14 19:08:26 user nova-compute[75205]:   <devices>
Nov 14 19:08:26 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:08:26 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:08:26 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk"/>
Nov 14 19:08:26 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:08:26 user nova-compute[75205]:     </disk>
Nov 14 19:08:26 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:08:26 user nova-compute[75205]:       <mac address="fa:16:3e:b4:63:ad"/>
Nov 14 19:08:26 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:26 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:08:26 user nova-compute[75205]:       <target dev="tap48790b5c-36"/>
Nov 14 19:08:26 user nova-compute[75205]:     </interface>
Nov 14 19:08:26 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:08:26 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/console.log" append="off"/>
Nov 14 19:08:26 user nova-compute[75205]:     </serial>
Nov 14 19:08:26 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:08:26 user nova-compute[75205]:     <video>
Nov 14 19:08:26 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:26 user nova-compute[75205]:     </video>
Nov 14 19:08:26 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:08:26 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:08:26 user nova-compute[75205]:     </rng>
Nov 14 19:08:26 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:08:26 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:08:26 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:08:26 user nova-compute[75205]:     </memballoon>
Nov 14 19:08:26 user nova-compute[75205]:   </devices>
Nov 14 19:08:26 user nova-compute[75205]: </domain>
Nov 14 19:08:26 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1320716125',display_name='tempest-DeleteServersTestJSON-server-1320716125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1320716125',id=1,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae966ad209f94612b452b66061acef49',ramdisk_id='',reservation_id='r-yth6p5ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2128794415',owner_user_name='tempest-DeleteServersTestJSON-2128794415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:20Z,user_data=None,user_id='280535afeca94ec2919ecfa36a9e26b7',uuid=f185f08b-ea86-40f4-af2b-95badfddca27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Converting VIF {"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:63:ad,bridge_name='br-int',has_traffic_filtering=True,id=48790b5c-36b5-4f62-917c-7d6895779497,network=Network(45abb6e8-1123-46aa-ae2f-ebd635826ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48790b5c-36') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG os_vif [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:63:ad,bridge_name='br-int',has_traffic_filtering=True,id=48790b5c-36b5-4f62-917c-7d6895779497,network=Network(45abb6e8-1123-46aa-ae2f-ebd635826ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48790b5c-36') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd27b9ac6-3541-5621-868b-49e5c7087916', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:08:26 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:08:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.policy [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49f6cbfae91a4b388f1430a3b7a2707c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e772e661157e4c6e93e46e7dd9f42f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.network.neutron [req-4ef559b6-27a7-4504-93cd-05e46719549b req-cb3c7bc2-9028-46aa-a577-042409268c76 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updated VIF entry in instance network info cache for port 33605006-0418-423d-b2f9-f7ac03767374. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.network.neutron [req-4ef559b6-27a7-4504-93cd-05e46719549b req-cb3c7bc2-9028-46aa-a577-042409268c76 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updating instance_info_cache with network_info: [{"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:08:27 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Creating image(s)
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4ef559b6-27a7-4504-93cd-05e46719549b req-cb3c7bc2-9028-46aa-a577-042409268c76 service nova] Releasing lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.208s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk 1073741824" returned: 0 in 0.048s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.network.neutron [req-be27b436-6a2b-4100-b431-dc03d9eec5ef req-82836c88-0a41-430b-91a3-ba08f9aa8afc service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Updated VIF entry in instance network info cache for port 48790b5c-36b5-4f62-917c-7d6895779497. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.network.neutron [req-be27b436-6a2b-4100-b431-dc03d9eec5ef req-82836c88-0a41-430b-91a3-ba08f9aa8afc service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Updating instance_info_cache with network_info: [{"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-be27b436-6a2b-4100-b431-dc03d9eec5ef req-82836c88-0a41-430b-91a3-ba08f9aa8afc service nova] Releasing lock "refresh_cache-f185f08b-ea86-40f4-af2b-95badfddca27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.203s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Cannot resize image /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Ensure instance console log exists: /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:27 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Successfully created port: 531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:08:28 user sudo[84537]: pam_unix(sudo:session): session closed for user root
Nov 14 19:08:28 user nova-compute[75205]: INFO oslo.privsep.daemon [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Spawned new privsep daemon via rootwrap
Nov 14 19:08:28 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 19:08:28 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 19:08:28 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 19:08:28 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84577
Nov 14 19:08:28 user nova-compute[75205]: WARNING oslo_privsep.priv_context [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] privsep daemon already running
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48790b5c-36, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48790b5c-36, col_values=(('qos', UUID('70ab0b13-72b6-4e47-8bdb-9e0ef38055eb')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48790b5c-36, col_values=(('external_ids', {'iface-id': '48790b5c-36b5-4f62-917c-7d6895779497', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:63:ad', 'vm-uuid': 'f185f08b-ea86-40f4-af2b-95badfddca27'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:08:28 user nova-compute[75205]: INFO nova.compute.claims [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Claim successful on node user
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:28 user nova-compute[75205]: INFO os_vif [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:63:ad,bridge_name='br-int',has_traffic_filtering=True,id=48790b5c-36b5-4f62-917c-7d6895779497,network=Network(45abb6e8-1123-46aa-ae2f-ebd635826ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48790b5c-36')
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33605006-04, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33605006-04, col_values=(('qos', UUID('b03c7a91-f6a7-47ee-970a-d7697d6e0234')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33605006-04, col_values=(('external_ids', {'iface-id': '33605006-0418-423d-b2f9-f7ac03767374', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:d2:85', 'vm-uuid': '6e3657fa-d795-4732-852a-158c68452387'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:28 user nova-compute[75205]: INFO os_vif [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=33605006-0418-423d-b2f9-f7ac03767374,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33605006-04')
Nov 14 19:08:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No VIF found with MAC fa:16:3e:f9:d2:85, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:08:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] No VIF found with MAC fa:16:3e:b4:63:ad, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:08:29 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Successfully updated port: 531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquired lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.policy [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '792e949c53df4fe390f93c0118590bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42501d5d4964f49b8fe62e9c9c2bd24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-fb8e67dc-5915-4b82-a9f1-2c19aa940c10 req-92529741-8362-4fb9-b11b-b14592efd190 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-changed-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-fb8e67dc-5915-4b82-a9f1-2c19aa940c10 req-92529741-8362-4fb9-b11b-b14592efd190 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Refreshing instance network info cache due to event network-changed-531d9209-139e-4463-9116-04f04ddca88e. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fb8e67dc-5915-4b82-a9f1-2c19aa940c10 req-92529741-8362-4fb9-b11b-b14592efd190 service nova] Acquiring lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:08:29 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Creating image(s)
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "/opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "/opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.195s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk 1073741824" returned: 0 in 0.055s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updating instance_info_cache with network_info: [{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Releasing lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Instance network_info: |[{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fb8e67dc-5915-4b82-a9f1-2c19aa940c10 req-92529741-8362-4fb9-b11b-b14592efd190 service nova] Acquired lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.network.neutron [req-fb8e67dc-5915-4b82-a9f1-2c19aa940c10 req-92529741-8362-4fb9-b11b-b14592efd190 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Refreshing network info cache for port 531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Start _get_guest_xml network_info=[{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:08:30 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:30 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1676998227',display_name='tempest-ServerStableDeviceRescueTest-server-1676998227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1676998227',id=3,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMICd9+/orLPOsksqqlXHWvNgODZ4beOKu5xU3X7tWgZC7C97oMTnqzPjEA1MxOE12JNfb4DNQCXeLb4+/3grN8spf9YFebiUCphHxLaLozc5X8YRCA0KWPqw4Wn2b/wOw==',key_name='tempest-keypair-1396550108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e772e661157e4c6e93e46e7dd9f42f0c',ramdisk_id='',reservation_id='r-d71nwys7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-660038347',owner_user_name='tempest-ServerStableDeviceRescueTest-660038347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49f6cbfae91a4b388f1430a3b7a2707c',uuid=92c7bf54-2b89-4a52-ab91-5ece2bd48b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Converting VIF {"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:db:ab,bridge_name='br-int',has_traffic_filtering=True,id=531d9209-139e-4463-9116-04f04ddca88e,network=Network(3c910353-259e-4f46-87f3-f8e4aea096e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531d9209-13') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'pci_devices' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:08:30 user nova-compute[75205]:   <uuid>92c7bf54-2b89-4a52-ab91-5ece2bd48b73</uuid>
Nov 14 19:08:30 user nova-compute[75205]:   <name>instance-00000003</name>
Nov 14 19:08:30 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:08:30 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:08:30 user nova-compute[75205]:   <metadata>
Nov 14 19:08:30 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:08:30 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:08:30 user nova-compute[75205]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1676998227</nova:name>
Nov 14 19:08:30 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:08:30</nova:creationTime>
Nov 14 19:08:30 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:08:30 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:08:30 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:08:30 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:08:30 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:08:30 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:08:30 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:08:30 user nova-compute[75205]:       <nova:owner>
Nov 14 19:08:30 user nova-compute[75205]:         <nova:user uuid="49f6cbfae91a4b388f1430a3b7a2707c">tempest-ServerStableDeviceRescueTest-660038347-project-member</nova:user>
Nov 14 19:08:30 user nova-compute[75205]:         <nova:project uuid="e772e661157e4c6e93e46e7dd9f42f0c">tempest-ServerStableDeviceRescueTest-660038347</nova:project>
Nov 14 19:08:30 user nova-compute[75205]:       </nova:owner>
Nov 14 19:08:30 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:08:30 user nova-compute[75205]:       <nova:ports>
Nov 14 19:08:30 user nova-compute[75205]:         <nova:port uuid="531d9209-139e-4463-9116-04f04ddca88e">
Nov 14 19:08:30 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 19:08:30 user nova-compute[75205]:         </nova:port>
Nov 14 19:08:30 user nova-compute[75205]:       </nova:ports>
Nov 14 19:08:30 user nova-compute[75205]:     </nova:instance>
Nov 14 19:08:30 user nova-compute[75205]:   </metadata>
Nov 14 19:08:30 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:08:30 user nova-compute[75205]:     <system>
Nov 14 19:08:30 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:08:30 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:08:30 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:08:30 user nova-compute[75205]:       <entry name="serial">92c7bf54-2b89-4a52-ab91-5ece2bd48b73</entry>
Nov 14 19:08:30 user nova-compute[75205]:       <entry name="uuid">92c7bf54-2b89-4a52-ab91-5ece2bd48b73</entry>
Nov 14 19:08:30 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:08:30 user nova-compute[75205]:     </system>
Nov 14 19:08:30 user nova-compute[75205]:   </sysinfo>
Nov 14 19:08:30 user nova-compute[75205]:   <os>
Nov 14 19:08:30 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:08:30 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:08:30 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:08:30 user nova-compute[75205]:   </os>
Nov 14 19:08:30 user nova-compute[75205]:   <features>
Nov 14 19:08:30 user nova-compute[75205]:     <acpi/>
Nov 14 19:08:30 user nova-compute[75205]:     <apic/>
Nov 14 19:08:30 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:08:30 user nova-compute[75205]:   </features>
Nov 14 19:08:30 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:08:30 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:08:30 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:08:30 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:08:30 user nova-compute[75205]:   </clock>
Nov 14 19:08:30 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:08:30 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:08:30 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:08:30 user nova-compute[75205]:   </cpu>
Nov 14 19:08:30 user nova-compute[75205]:   <devices>
Nov 14 19:08:30 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:08:30 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:08:30 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk"/>
Nov 14 19:08:30 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:08:30 user nova-compute[75205]:     </disk>
Nov 14 19:08:30 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:08:30 user nova-compute[75205]:       <mac address="fa:16:3e:36:db:ab"/>
Nov 14 19:08:30 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:30 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:08:30 user nova-compute[75205]:       <target dev="tap531d9209-13"/>
Nov 14 19:08:30 user nova-compute[75205]:     </interface>
Nov 14 19:08:30 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:08:30 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/console.log" append="off"/>
Nov 14 19:08:30 user nova-compute[75205]:     </serial>
Nov 14 19:08:30 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:08:30 user nova-compute[75205]:     <video>
Nov 14 19:08:30 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:30 user nova-compute[75205]:     </video>
Nov 14 19:08:30 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:08:30 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:08:30 user nova-compute[75205]:     </rng>
Nov 14 19:08:30 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:08:30 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:08:30 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:08:30 user nova-compute[75205]:     </memballoon>
Nov 14 19:08:30 user nova-compute[75205]:   </devices>
Nov 14 19:08:30 user nova-compute[75205]: </domain>
Nov 14 19:08:30 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1676998227',display_name='tempest-ServerStableDeviceRescueTest-server-1676998227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1676998227',id=3,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMICd9+/orLPOsksqqlXHWvNgODZ4beOKu5xU3X7tWgZC7C97oMTnqzPjEA1MxOE12JNfb4DNQCXeLb4+/3grN8spf9YFebiUCphHxLaLozc5X8YRCA0KWPqw4Wn2b/wOw==',key_name='tempest-keypair-1396550108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e772e661157e4c6e93e46e7dd9f42f0c',ramdisk_id='',reservation_id='r-d71nwys7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-660038347',owner_user_name='tempest-ServerStableDeviceRescueTest-660038347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49f6cbfae91a4b388f1430a3b7a2707c',uuid=92c7bf54-2b89-4a52-ab91-5ece2bd48b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Converting VIF {"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:db:ab,bridge_name='br-int',has_traffic_filtering=True,id=531d9209-139e-4463-9116-04f04ddca88e,network=Network(3c910353-259e-4f46-87f3-f8e4aea096e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531d9209-13') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG os_vif [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:db:ab,bridge_name='br-int',has_traffic_filtering=True,id=531d9209-139e-4463-9116-04f04ddca88e,network=Network(3c910353-259e-4f46-87f3-f8e4aea096e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531d9209-13') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7b4543a-589d-51cc-9a19-613ed0763031', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Cannot resize image /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Ensure instance console log exists: /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap531d9209-13, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap531d9209-13, col_values=(('qos', UUID('4701d9d9-f231-47c6-bc4b-bc799f2a1d09')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap531d9209-13, col_values=(('external_ids', {'iface-id': '531d9209-139e-4463-9116-04f04ddca88e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:db:ab', 'vm-uuid': '92c7bf54-2b89-4a52-ab91-5ece2bd48b73'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: INFO os_vif [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:db:ab,bridge_name='br-int',has_traffic_filtering=True,id=531d9209-139e-4463-9116-04f04ddca88e,network=Network(3c910353-259e-4f46-87f3-f8e4aea096e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531d9209-13')
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Successfully created port: e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] No VIF found with MAC fa:16:3e:36:db:ab, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG nova.network.neutron [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Successfully updated port: e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquired lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG nova.network.neutron [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG nova.network.neutron [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-210561a3-21ca-45b0-a445-8929cc04b03a req-26e7f803-6aa8-48d0-802f-19fdf5c773fe service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received event network-changed-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-210561a3-21ca-45b0-a445-8929cc04b03a req-26e7f803-6aa8-48d0-802f-19fdf5c773fe service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Refreshing instance network info cache due to event network-changed-e7dabbdd-806b-444d-87a4-0e944c8f8a88. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-210561a3-21ca-45b0-a445-8929cc04b03a req-26e7f803-6aa8-48d0-802f-19fdf5c773fe service nova] Acquiring lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG nova.network.neutron [req-fb8e67dc-5915-4b82-a9f1-2c19aa940c10 req-92529741-8362-4fb9-b11b-b14592efd190 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updated VIF entry in instance network info cache for port 531d9209-139e-4463-9116-04f04ddca88e. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG nova.network.neutron [req-fb8e67dc-5915-4b82-a9f1-2c19aa940c10 req-92529741-8362-4fb9-b11b-b14592efd190 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updating instance_info_cache with network_info: [{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fb8e67dc-5915-4b82-a9f1-2c19aa940c10 req-92529741-8362-4fb9-b11b-b14592efd190 service nova] Releasing lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.network.neutron [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Updating instance_info_cache with network_info: [{"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Releasing lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Instance network_info: |[{"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-210561a3-21ca-45b0-a445-8929cc04b03a req-26e7f803-6aa8-48d0-802f-19fdf5c773fe service nova] Acquired lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.network.neutron [req-210561a3-21ca-45b0-a445-8929cc04b03a req-26e7f803-6aa8-48d0-802f-19fdf5c773fe service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Refreshing network info cache for port e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Start _get_guest_xml network_info=[{"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:08:32 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:32 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1153990837',display_name='tempest-AttachVolumeNegativeTest-server-1153990837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1153990837',id=4,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOl5EMK6R+Wd5WVDrL2u3iwV3fRHuXKuwn8m63J4rBYC7r1sdx/LiORubJArdjMfGg/5TzdddKn64j7+kmufVtOpupS6nzhcaSQZx+0YV35u4/NobW9oHCUDRrtAdvyLQ==',key_name='tempest-keypair-1840008306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-reah2drt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=2d89bc07-90a1-49ef-8d67-e7263bd06e6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=e7dabbdd-806b-444d-87a4-0e944c8f8a88,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7dabbdd-80') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.objects.instance [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d89bc07-90a1-49ef-8d67-e7263bd06e6d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:08:32 user nova-compute[75205]:   <uuid>2d89bc07-90a1-49ef-8d67-e7263bd06e6d</uuid>
Nov 14 19:08:32 user nova-compute[75205]:   <name>instance-00000004</name>
Nov 14 19:08:32 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:08:32 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:08:32 user nova-compute[75205]:   <metadata>
Nov 14 19:08:32 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:08:32 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:08:32 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1153990837</nova:name>
Nov 14 19:08:32 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:08:32</nova:creationTime>
Nov 14 19:08:32 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:08:32 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:08:32 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:08:32 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:08:32 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:08:32 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:08:32 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:08:32 user nova-compute[75205]:       <nova:owner>
Nov 14 19:08:32 user nova-compute[75205]:         <nova:user uuid="792e949c53df4fe390f93c0118590bb6">tempest-AttachVolumeNegativeTest-1777396465-project-member</nova:user>
Nov 14 19:08:32 user nova-compute[75205]:         <nova:project uuid="d42501d5d4964f49b8fe62e9c9c2bd24">tempest-AttachVolumeNegativeTest-1777396465</nova:project>
Nov 14 19:08:32 user nova-compute[75205]:       </nova:owner>
Nov 14 19:08:32 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:08:32 user nova-compute[75205]:       <nova:ports>
Nov 14 19:08:32 user nova-compute[75205]:         <nova:port uuid="e7dabbdd-806b-444d-87a4-0e944c8f8a88">
Nov 14 19:08:32 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 19:08:32 user nova-compute[75205]:         </nova:port>
Nov 14 19:08:32 user nova-compute[75205]:       </nova:ports>
Nov 14 19:08:32 user nova-compute[75205]:     </nova:instance>
Nov 14 19:08:32 user nova-compute[75205]:   </metadata>
Nov 14 19:08:32 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:08:32 user nova-compute[75205]:     <system>
Nov 14 19:08:32 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:08:32 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:08:32 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:08:32 user nova-compute[75205]:       <entry name="serial">2d89bc07-90a1-49ef-8d67-e7263bd06e6d</entry>
Nov 14 19:08:32 user nova-compute[75205]:       <entry name="uuid">2d89bc07-90a1-49ef-8d67-e7263bd06e6d</entry>
Nov 14 19:08:32 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:08:32 user nova-compute[75205]:     </system>
Nov 14 19:08:32 user nova-compute[75205]:   </sysinfo>
Nov 14 19:08:32 user nova-compute[75205]:   <os>
Nov 14 19:08:32 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:08:32 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:08:32 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:08:32 user nova-compute[75205]:   </os>
Nov 14 19:08:32 user nova-compute[75205]:   <features>
Nov 14 19:08:32 user nova-compute[75205]:     <acpi/>
Nov 14 19:08:32 user nova-compute[75205]:     <apic/>
Nov 14 19:08:32 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:08:32 user nova-compute[75205]:   </features>
Nov 14 19:08:32 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:08:32 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:08:32 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:08:32 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:08:32 user nova-compute[75205]:   </clock>
Nov 14 19:08:32 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:08:32 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:08:32 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:08:32 user nova-compute[75205]:   </cpu>
Nov 14 19:08:32 user nova-compute[75205]:   <devices>
Nov 14 19:08:32 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:08:32 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:08:32 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk"/>
Nov 14 19:08:32 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:08:32 user nova-compute[75205]:     </disk>
Nov 14 19:08:32 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:08:32 user nova-compute[75205]:       <mac address="fa:16:3e:7b:8e:52"/>
Nov 14 19:08:32 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:32 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:08:32 user nova-compute[75205]:       <target dev="tape7dabbdd-80"/>
Nov 14 19:08:32 user nova-compute[75205]:     </interface>
Nov 14 19:08:32 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:08:32 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/console.log" append="off"/>
Nov 14 19:08:32 user nova-compute[75205]:     </serial>
Nov 14 19:08:32 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:08:32 user nova-compute[75205]:     <video>
Nov 14 19:08:32 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:32 user nova-compute[75205]:     </video>
Nov 14 19:08:32 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:08:32 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:08:32 user nova-compute[75205]:     </rng>
Nov 14 19:08:32 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:08:32 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:08:32 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:08:32 user nova-compute[75205]:     </memballoon>
Nov 14 19:08:32 user nova-compute[75205]:   </devices>
Nov 14 19:08:32 user nova-compute[75205]: </domain>
Nov 14 19:08:32 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1153990837',display_name='tempest-AttachVolumeNegativeTest-server-1153990837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1153990837',id=4,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOl5EMK6R+Wd5WVDrL2u3iwV3fRHuXKuwn8m63J4rBYC7r1sdx/LiORubJArdjMfGg/5TzdddKn64j7+kmufVtOpupS6nzhcaSQZx+0YV35u4/NobW9oHCUDRrtAdvyLQ==',key_name='tempest-keypair-1840008306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-reah2drt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=2d89bc07-90a1-49ef-8d67-e7263bd06e6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=e7dabbdd-806b-444d-87a4-0e944c8f8a88,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7dabbdd-80') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG os_vif [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=e7dabbdd-806b-444d-87a4-0e944c8f8a88,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7dabbdd-80') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0071edb6-d09a-5d8c-80a1-cab8325d14b7', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7dabbdd-80, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7dabbdd-80, col_values=(('qos', UUID('b926675a-b0a6-44ce-bac2-cdba9ee83dd4')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7dabbdd-80, col_values=(('external_ids', {'iface-id': 'e7dabbdd-806b-444d-87a4-0e944c8f8a88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:8e:52', 'vm-uuid': '2d89bc07-90a1-49ef-8d67-e7263bd06e6d'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:32 user nova-compute[75205]: INFO os_vif [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=e7dabbdd-806b-444d-87a4-0e944c8f8a88,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7dabbdd-80')
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No VIF found with MAC fa:16:3e:7b:8e:52, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:33 user nova-compute[75205]: DEBUG nova.network.neutron [req-210561a3-21ca-45b0-a445-8929cc04b03a req-26e7f803-6aa8-48d0-802f-19fdf5c773fe service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Updated VIF entry in instance network info cache for port e7dabbdd-806b-444d-87a4-0e944c8f8a88. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:08:33 user nova-compute[75205]: DEBUG nova.network.neutron [req-210561a3-21ca-45b0-a445-8929cc04b03a req-26e7f803-6aa8-48d0-802f-19fdf5c773fe service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Updating instance_info_cache with network_info: [{"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-210561a3-21ca-45b0-a445-8929cc04b03a req-26e7f803-6aa8-48d0-802f-19fdf5c773fe service nova] Releasing lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:08:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:08:34 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 6e3657fa-d795-4732-852a-158c68452387] Instance spawned successfully.
Nov 14 19:08:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:08:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:34 user nova-compute[75205]: INFO nova.compute.manager [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Took 12.42 seconds to spawn the instance on the hypervisor.
Nov 14 19:08:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:08:34 user nova-compute[75205]: INFO nova.compute.manager [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Took 13.18 seconds to build instance.
Nov 14 19:08:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e5c6c603-efee-495c-89d3-6a1620cfbf48 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "6e3657fa-d795-4732-852a-158c68452387" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.302s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-9cb592e5-826a-4cd1-a2d8-2d0917917072 req-bae120e9-6475-4a46-b845-1109a5ab6fd5 service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Received event network-vif-plugged-48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9cb592e5-826a-4cd1-a2d8-2d0917917072 req-bae120e9-6475-4a46-b845-1109a5ab6fd5 service nova] Acquiring lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9cb592e5-826a-4cd1-a2d8-2d0917917072 req-bae120e9-6475-4a46-b845-1109a5ab6fd5 service nova] Lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9cb592e5-826a-4cd1-a2d8-2d0917917072 req-bae120e9-6475-4a46-b845-1109a5ab6fd5 service nova] Lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-9cb592e5-826a-4cd1-a2d8-2d0917917072 req-bae120e9-6475-4a46-b845-1109a5ab6fd5 service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] No waiting events found dispatching network-vif-plugged-48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:08:35 user nova-compute[75205]: WARNING nova.compute.manager [req-9cb592e5-826a-4cd1-a2d8-2d0917917072 req-bae120e9-6475-4a46-b845-1109a5ab6fd5 service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Received unexpected event network-vif-plugged-48790b5c-36b5-4f62-917c-7d6895779497 for instance with vm_state building and task_state spawning.
Nov 14 19:08:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:08:37 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Instance spawned successfully.
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: INFO nova.compute.manager [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Took 10.34 seconds to spawn the instance on the hypervisor.
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Received event network-vif-plugged-48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] Acquiring lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] Lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] Lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] No waiting events found dispatching network-vif-plugged-48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:08:37 user nova-compute[75205]: WARNING nova.compute.manager [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Received unexpected event network-vif-plugged-48790b5c-36b5-4f62-917c-7d6895779497 for instance with vm_state building and task_state spawning.
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received event network-vif-plugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] Acquiring lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] No waiting events found dispatching network-vif-plugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:08:37 user nova-compute[75205]: WARNING nova.compute.manager [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received unexpected event network-vif-plugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 for instance with vm_state building and task_state spawning.
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received event network-vif-plugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] Acquiring lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] No waiting events found dispatching network-vif-plugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:08:37 user nova-compute[75205]: WARNING nova.compute.manager [req-c66d2606-4ba8-4c67-974e-31bff12926d0 req-76cd80b8-56bb-45de-bed1-67b5999066fc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received unexpected event network-vif-plugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 for instance with vm_state building and task_state spawning.
Nov 14 19:08:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:08:37 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Instance spawned successfully.
Nov 14 19:08:37 user nova-compute[75205]: INFO nova.compute.manager [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Took 11.29 seconds to build instance.
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7aaabbb8-576b-4c13-83b1-ce593a0fd18d tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.439s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:08:37 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Instance spawned successfully.
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:38 user nova-compute[75205]: INFO nova.compute.manager [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Took 8.34 seconds to spawn the instance on the hypervisor.
Nov 14 19:08:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:08:38 user nova-compute[75205]: INFO nova.compute.manager [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Took 17.69 seconds to spawn the instance on the hypervisor.
Nov 14 19:08:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:08:38 user nova-compute[75205]: INFO nova.compute.manager [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Took 9.51 seconds to build instance.
Nov 14 19:08:38 user nova-compute[75205]: INFO nova.compute.manager [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Took 18.99 seconds to build instance.
Nov 14 19:08:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-08a93d25-f3b8-4227-8123-5775a34066b0 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.666s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bad69f5e-c64b-4d79-acab-a62602e25f78 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "f185f08b-ea86-40f4-af2b-95badfddca27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.202s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:43 user nova-compute[75205]: DEBUG nova.compute.manager [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:08:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:44 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:08:44 user nova-compute[75205]: INFO nova.compute.claims [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Claim successful on node user
Nov 14 19:08:45 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.873s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG nova.network.neutron [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:08:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:08:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG nova.policy [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53dc67514dda4ef7b51122f81c6feb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba7425d60794409b74ed4fe0e902536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:08:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Creating image(s)
Nov 14 19:08:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "/opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "/opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.398s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.251s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk 1073741824" returned: 0 in 0.076s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.252s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG nova.network.neutron [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Successfully created port: ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Cannot resize image /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Ensure instance console log exists: /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Successfully updated port: ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquired lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-40c20db2-0601-44c4-8507-b3b4b6c31053 req-450b25a1-cddf-4c55-8e0d-b8525f744e3f service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received event network-changed-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-40c20db2-0601-44c4-8507-b3b4b6c31053 req-450b25a1-cddf-4c55-8e0d-b8525f744e3f service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Refreshing instance network info cache due to event network-changed-ff69d5ef-6600-4426-a4e1-f0116599ebfc. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-40c20db2-0601-44c4-8507-b3b4b6c31053 req-450b25a1-cddf-4c55-8e0d-b8525f744e3f service nova] Acquiring lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:08:48 user nova-compute[75205]: INFO nova.compute.claims [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Claim successful on node user
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Updating instance_info_cache with network_info: [{"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Releasing lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Instance network_info: |[{"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-40c20db2-0601-44c4-8507-b3b4b6c31053 req-450b25a1-cddf-4c55-8e0d-b8525f744e3f service nova] Acquired lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.network.neutron [req-40c20db2-0601-44c4-8507-b3b4b6c31053 req-450b25a1-cddf-4c55-8e0d-b8525f744e3f service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Refreshing network info cache for port ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Start _get_guest_xml network_info=[{"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:08:48 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:48 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2146645887',display_name='tempest-VolumesAdminNegativeTest-server-2146645887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2146645887',id=5,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMlslY8PczHJAYRFDpr6styuNSzMMwsJwh1nfBGdF3FZWnRgSsqpEbRMhCCAGoLGOYjQrtBOF0nB5hrur5PEyQwz/y3ORSMwSwYAd7OYnRgBd3QFK243abTe8HSkuY3oA==',key_name='tempest-keypair-524423915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ba7425d60794409b74ed4fe0e902536',ramdisk_id='',reservation_id='r-srppx44e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-368867561',owner_user_name='tempest-VolumesAdminNegativeTest-368867561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53dc67514dda4ef7b51122f81c6feb02',uuid=1f24f442-1547-4f20-ba7c-f7790dcc37af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converting VIF {"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=ff69d5ef-6600-4426-a4e1-f0116599ebfc,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff69d5ef-66') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:48 user nova-compute[75205]: DEBUG nova.objects.instance [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f24f442-1547-4f20-ba7c-f7790dcc37af {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:08:49 user nova-compute[75205]:   <uuid>1f24f442-1547-4f20-ba7c-f7790dcc37af</uuid>
Nov 14 19:08:49 user nova-compute[75205]:   <name>instance-00000005</name>
Nov 14 19:08:49 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:08:49 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:08:49 user nova-compute[75205]:   <metadata>
Nov 14 19:08:49 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:08:49 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:08:49 user nova-compute[75205]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2146645887</nova:name>
Nov 14 19:08:49 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:08:48</nova:creationTime>
Nov 14 19:08:49 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:08:49 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:08:49 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:08:49 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:08:49 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:08:49 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:08:49 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:08:49 user nova-compute[75205]:       <nova:owner>
Nov 14 19:08:49 user nova-compute[75205]:         <nova:user uuid="53dc67514dda4ef7b51122f81c6feb02">tempest-VolumesAdminNegativeTest-368867561-project-member</nova:user>
Nov 14 19:08:49 user nova-compute[75205]:         <nova:project uuid="8ba7425d60794409b74ed4fe0e902536">tempest-VolumesAdminNegativeTest-368867561</nova:project>
Nov 14 19:08:49 user nova-compute[75205]:       </nova:owner>
Nov 14 19:08:49 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:08:49 user nova-compute[75205]:       <nova:ports>
Nov 14 19:08:49 user nova-compute[75205]:         <nova:port uuid="ff69d5ef-6600-4426-a4e1-f0116599ebfc">
Nov 14 19:08:49 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 19:08:49 user nova-compute[75205]:         </nova:port>
Nov 14 19:08:49 user nova-compute[75205]:       </nova:ports>
Nov 14 19:08:49 user nova-compute[75205]:     </nova:instance>
Nov 14 19:08:49 user nova-compute[75205]:   </metadata>
Nov 14 19:08:49 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:08:49 user nova-compute[75205]:     <system>
Nov 14 19:08:49 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:08:49 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:08:49 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:08:49 user nova-compute[75205]:       <entry name="serial">1f24f442-1547-4f20-ba7c-f7790dcc37af</entry>
Nov 14 19:08:49 user nova-compute[75205]:       <entry name="uuid">1f24f442-1547-4f20-ba7c-f7790dcc37af</entry>
Nov 14 19:08:49 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:08:49 user nova-compute[75205]:     </system>
Nov 14 19:08:49 user nova-compute[75205]:   </sysinfo>
Nov 14 19:08:49 user nova-compute[75205]:   <os>
Nov 14 19:08:49 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:08:49 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:08:49 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:08:49 user nova-compute[75205]:   </os>
Nov 14 19:08:49 user nova-compute[75205]:   <features>
Nov 14 19:08:49 user nova-compute[75205]:     <acpi/>
Nov 14 19:08:49 user nova-compute[75205]:     <apic/>
Nov 14 19:08:49 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:08:49 user nova-compute[75205]:   </features>
Nov 14 19:08:49 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:08:49 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:08:49 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:08:49 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:08:49 user nova-compute[75205]:   </clock>
Nov 14 19:08:49 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:08:49 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:08:49 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:08:49 user nova-compute[75205]:   </cpu>
Nov 14 19:08:49 user nova-compute[75205]:   <devices>
Nov 14 19:08:49 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:08:49 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:08:49 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk"/>
Nov 14 19:08:49 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:08:49 user nova-compute[75205]:     </disk>
Nov 14 19:08:49 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:08:49 user nova-compute[75205]:       <mac address="fa:16:3e:f4:dc:26"/>
Nov 14 19:08:49 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:49 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:08:49 user nova-compute[75205]:       <target dev="tapff69d5ef-66"/>
Nov 14 19:08:49 user nova-compute[75205]:     </interface>
Nov 14 19:08:49 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:08:49 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/console.log" append="off"/>
Nov 14 19:08:49 user nova-compute[75205]:     </serial>
Nov 14 19:08:49 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:08:49 user nova-compute[75205]:     <video>
Nov 14 19:08:49 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:49 user nova-compute[75205]:     </video>
Nov 14 19:08:49 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:08:49 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:08:49 user nova-compute[75205]:     </rng>
Nov 14 19:08:49 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:08:49 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:08:49 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:08:49 user nova-compute[75205]:     </memballoon>
Nov 14 19:08:49 user nova-compute[75205]:   </devices>
Nov 14 19:08:49 user nova-compute[75205]: </domain>
Nov 14 19:08:49 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2146645887',display_name='tempest-VolumesAdminNegativeTest-server-2146645887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2146645887',id=5,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMlslY8PczHJAYRFDpr6styuNSzMMwsJwh1nfBGdF3FZWnRgSsqpEbRMhCCAGoLGOYjQrtBOF0nB5hrur5PEyQwz/y3ORSMwSwYAd7OYnRgBd3QFK243abTe8HSkuY3oA==',key_name='tempest-keypair-524423915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ba7425d60794409b74ed4fe0e902536',ramdisk_id='',reservation_id='r-srppx44e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-368867561',owner_user_name='tempest-VolumesAdminNegativeTest-368867561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53dc67514dda4ef7b51122f81c6feb02',uuid=1f24f442-1547-4f20-ba7c-f7790dcc37af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converting VIF {"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=ff69d5ef-6600-4426-a4e1-f0116599ebfc,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff69d5ef-66') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG os_vif [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=ff69d5ef-6600-4426-a4e1-f0116599ebfc,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff69d5ef-66') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d981427-dc10-5160-9f3a-6688ae09423f', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff69d5ef-66, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff69d5ef-66, col_values=(('qos', UUID('dac71f85-35d4-4040-a72e-0519a9e1ad99')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff69d5ef-66, col_values=(('external_ids', {'iface-id': 'ff69d5ef-6600-4426-a4e1-f0116599ebfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:dc:26', 'vm-uuid': '1f24f442-1547-4f20-ba7c-f7790dcc37af'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:49 user nova-compute[75205]: INFO os_vif [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=ff69d5ef-6600-4426-a4e1-f0116599ebfc,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff69d5ef-66')
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] No VIF found with MAC fa:16:3e:f4:dc:26, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.network.neutron [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:08:49 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.policy [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65487f5c81204b0d86821d4a0eec289c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaa2f5d6a94a368051677cc0d85b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.network.neutron [req-40c20db2-0601-44c4-8507-b3b4b6c31053 req-450b25a1-cddf-4c55-8e0d-b8525f744e3f service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Updated VIF entry in instance network info cache for port ff69d5ef-6600-4426-a4e1-f0116599ebfc. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.network.neutron [req-40c20db2-0601-44c4-8507-b3b4b6c31053 req-450b25a1-cddf-4c55-8e0d-b8525f744e3f service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Updating instance_info_cache with network_info: [{"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-40c20db2-0601-44c4-8507-b3b4b6c31053 req-450b25a1-cddf-4c55-8e0d-b8525f744e3f service nova] Releasing lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:08:49 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Creating image(s)
Nov 14 19:08:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.230s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.309s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk 1073741824" returned: 0 in 0.081s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.400s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.270s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Successfully created port: 56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Cannot resize image /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Ensure instance console log exists: /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Successfully updated port: 56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquired lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-b6bfc363-7aa4-4ce6-9a15-51e2576100b4 req-46850a30-f2d9-4ad4-a3f1-e9f2c36f5ae5 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-changed-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-b6bfc363-7aa4-4ce6-9a15-51e2576100b4 req-46850a30-f2d9-4ad4-a3f1-e9f2c36f5ae5 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Refreshing instance network info cache due to event network-changed-56984858-000b-45d7-a6f0-13dc113e14f6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b6bfc363-7aa4-4ce6-9a15-51e2576100b4 req-46850a30-f2d9-4ad4-a3f1-e9f2c36f5ae5 service nova] Acquiring lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.network.neutron [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updating instance_info_cache with network_info: [{"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Releasing lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Instance network_info: |[{"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b6bfc363-7aa4-4ce6-9a15-51e2576100b4 req-46850a30-f2d9-4ad4-a3f1-e9f2c36f5ae5 service nova] Acquired lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-b6bfc363-7aa4-4ce6-9a15-51e2576100b4 req-46850a30-f2d9-4ad4-a3f1-e9f2c36f5ae5 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Refreshing network info cache for port 56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Start _get_guest_xml network_info=[{"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:08:52 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:52 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923454376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923454376',id=6,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkRIwsBeDyQ11FuXQIwqoygHpHsgf3Cdt8fX3locV211FBgH9EBzW/BZRFfpB5sEUt5eCT8S2LhivMEVz8NcFsdFBPYZakdFldF/6rJgd/n1gME/tmQkgZpjcxprOgRtg==',key_name='tempest-keypair-1747689188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11eaa2f5d6a94a368051677cc0d85b33',ramdisk_id='',reservation_id='r-nrqchh9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-551564993',owner_user_name='tempest-TaggedAttachmentsTest-551564993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65487f5c81204b0d86821d4a0eec289c',uuid=b2696233-b1c2-466d-92f1-0a30c3db1501,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converting VIF {"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1f:1e,bridge_name='br-int',has_traffic_filtering=True,id=56984858-000b-45d7-a6f0-13dc113e14f6,network=Network(154707de-2911-4f74-84b7-3b6c612d38e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56984858-00') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.objects.instance [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lazy-loading 'pci_devices' on Instance uuid b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:08:52 user nova-compute[75205]:   <uuid>b2696233-b1c2-466d-92f1-0a30c3db1501</uuid>
Nov 14 19:08:52 user nova-compute[75205]:   <name>instance-00000006</name>
Nov 14 19:08:52 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:08:52 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:08:52 user nova-compute[75205]:   <metadata>
Nov 14 19:08:52 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:08:52 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:08:52 user nova-compute[75205]:       <nova:name>tempest-device-tagging-server-923454376</nova:name>
Nov 14 19:08:52 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:08:52</nova:creationTime>
Nov 14 19:08:52 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:08:52 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:08:52 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:08:52 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:08:52 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:08:52 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:08:52 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:08:52 user nova-compute[75205]:       <nova:owner>
Nov 14 19:08:52 user nova-compute[75205]:         <nova:user uuid="65487f5c81204b0d86821d4a0eec289c">tempest-TaggedAttachmentsTest-551564993-project-member</nova:user>
Nov 14 19:08:52 user nova-compute[75205]:         <nova:project uuid="11eaa2f5d6a94a368051677cc0d85b33">tempest-TaggedAttachmentsTest-551564993</nova:project>
Nov 14 19:08:52 user nova-compute[75205]:       </nova:owner>
Nov 14 19:08:52 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:08:52 user nova-compute[75205]:       <nova:ports>
Nov 14 19:08:52 user nova-compute[75205]:         <nova:port uuid="56984858-000b-45d7-a6f0-13dc113e14f6">
Nov 14 19:08:52 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:08:52 user nova-compute[75205]:         </nova:port>
Nov 14 19:08:52 user nova-compute[75205]:       </nova:ports>
Nov 14 19:08:52 user nova-compute[75205]:     </nova:instance>
Nov 14 19:08:52 user nova-compute[75205]:   </metadata>
Nov 14 19:08:52 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:08:52 user nova-compute[75205]:     <system>
Nov 14 19:08:52 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:08:52 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:08:52 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:08:52 user nova-compute[75205]:       <entry name="serial">b2696233-b1c2-466d-92f1-0a30c3db1501</entry>
Nov 14 19:08:52 user nova-compute[75205]:       <entry name="uuid">b2696233-b1c2-466d-92f1-0a30c3db1501</entry>
Nov 14 19:08:52 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:08:52 user nova-compute[75205]:     </system>
Nov 14 19:08:52 user nova-compute[75205]:   </sysinfo>
Nov 14 19:08:52 user nova-compute[75205]:   <os>
Nov 14 19:08:52 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:08:52 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:08:52 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:08:52 user nova-compute[75205]:   </os>
Nov 14 19:08:52 user nova-compute[75205]:   <features>
Nov 14 19:08:52 user nova-compute[75205]:     <acpi/>
Nov 14 19:08:52 user nova-compute[75205]:     <apic/>
Nov 14 19:08:52 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:08:52 user nova-compute[75205]:   </features>
Nov 14 19:08:52 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:08:52 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:08:52 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:08:52 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:08:52 user nova-compute[75205]:   </clock>
Nov 14 19:08:52 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:08:52 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:08:52 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:08:52 user nova-compute[75205]:   </cpu>
Nov 14 19:08:52 user nova-compute[75205]:   <devices>
Nov 14 19:08:52 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:08:52 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:08:52 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk"/>
Nov 14 19:08:52 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:08:52 user nova-compute[75205]:     </disk>
Nov 14 19:08:52 user nova-compute[75205]:     <disk type="file" device="cdrom">
Nov 14 19:08:52 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 19:08:52 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.config"/>
Nov 14 19:08:52 user nova-compute[75205]:       <target dev="hda" bus="ide"/>
Nov 14 19:08:52 user nova-compute[75205]:     </disk>
Nov 14 19:08:52 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:08:52 user nova-compute[75205]:       <mac address="fa:16:3e:e0:1f:1e"/>
Nov 14 19:08:52 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:52 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:08:52 user nova-compute[75205]:       <target dev="tap56984858-00"/>
Nov 14 19:08:52 user nova-compute[75205]:     </interface>
Nov 14 19:08:52 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:08:52 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/console.log" append="off"/>
Nov 14 19:08:52 user nova-compute[75205]:     </serial>
Nov 14 19:08:52 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:08:52 user nova-compute[75205]:     <video>
Nov 14 19:08:52 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:52 user nova-compute[75205]:     </video>
Nov 14 19:08:52 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:08:52 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:08:52 user nova-compute[75205]:     </rng>
Nov 14 19:08:52 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:08:52 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:08:52 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:08:52 user nova-compute[75205]:     </memballoon>
Nov 14 19:08:52 user nova-compute[75205]:   </devices>
Nov 14 19:08:52 user nova-compute[75205]: </domain>
Nov 14 19:08:52 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923454376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923454376',id=6,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkRIwsBeDyQ11FuXQIwqoygHpHsgf3Cdt8fX3locV211FBgH9EBzW/BZRFfpB5sEUt5eCT8S2LhivMEVz8NcFsdFBPYZakdFldF/6rJgd/n1gME/tmQkgZpjcxprOgRtg==',key_name='tempest-keypair-1747689188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11eaa2f5d6a94a368051677cc0d85b33',ramdisk_id='',reservation_id='r-nrqchh9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-551564993',owner_user_name='tempest-TaggedAttachmentsTest-551564993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65487f5c81204b0d86821d4a0eec289c',uuid=b2696233-b1c2-466d-92f1-0a30c3db1501,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converting VIF {"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1f:1e,bridge_name='br-int',has_traffic_filtering=True,id=56984858-000b-45d7-a6f0-13dc113e14f6,network=Network(154707de-2911-4f74-84b7-3b6c612d38e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56984858-00') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG os_vif [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1f:1e,bridge_name='br-int',has_traffic_filtering=True,id=56984858-000b-45d7-a6f0-13dc113e14f6,network=Network(154707de-2911-4f74-84b7-3b6c612d38e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56984858-00') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00736280-1925-5dac-bbd8-2ea68e9dfb16', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56984858-00, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56984858-00, col_values=(('qos', UUID('583a55d7-2e02-422c-a1ce-5b24d849c910')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56984858-00, col_values=(('external_ids', {'iface-id': '56984858-000b-45d7-a6f0-13dc113e14f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:1f:1e', 'vm-uuid': 'b2696233-b1c2-466d-92f1-0a30c3db1501'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:52 user nova-compute[75205]: INFO os_vif [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1f:1e,bridge_name='br-int',has_traffic_filtering=True,id=56984858-000b-45d7-a6f0-13dc113e14f6,network=Network(154707de-2911-4f74-84b7-3b6c612d38e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56984858-00')
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] No BDM found with device name hda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:08:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] No VIF found with MAC fa:16:3e:e0:1f:1e, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:08:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Using config drive
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-b6bfc363-7aa4-4ce6-9a15-51e2576100b4 req-46850a30-f2d9-4ad4-a3f1-e9f2c36f5ae5 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updated VIF entry in instance network info cache for port 56984858-000b-45d7-a6f0-13dc113e14f6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-b6bfc363-7aa4-4ce6-9a15-51e2576100b4 req-46850a30-f2d9-4ad4-a3f1-e9f2c36f5ae5 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updating instance_info_cache with network_info: [{"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b6bfc363-7aa4-4ce6-9a15-51e2576100b4 req-46850a30-f2d9-4ad4-a3f1-e9f2c36f5ae5 service nova] Releasing lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-3dc3e8c6-3912-4ad4-9c07-b7cce75d6a34 req-3f4d8d2a-fab0-4846-aeae-4ab0cbebd0f1 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Received event network-vif-plugged-33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3dc3e8c6-3912-4ad4-9c07-b7cce75d6a34 req-3f4d8d2a-fab0-4846-aeae-4ab0cbebd0f1 service nova] Acquiring lock "6e3657fa-d795-4732-852a-158c68452387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3dc3e8c6-3912-4ad4-9c07-b7cce75d6a34 req-3f4d8d2a-fab0-4846-aeae-4ab0cbebd0f1 service nova] Lock "6e3657fa-d795-4732-852a-158c68452387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3dc3e8c6-3912-4ad4-9c07-b7cce75d6a34 req-3f4d8d2a-fab0-4846-aeae-4ab0cbebd0f1 service nova] Lock "6e3657fa-d795-4732-852a-158c68452387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-3dc3e8c6-3912-4ad4-9c07-b7cce75d6a34 req-3f4d8d2a-fab0-4846-aeae-4ab0cbebd0f1 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] No waiting events found dispatching network-vif-plugged-33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:08:53 user nova-compute[75205]: WARNING nova.compute.manager [req-3dc3e8c6-3912-4ad4-9c07-b7cce75d6a34 req-3f4d8d2a-fab0-4846-aeae-4ab0cbebd0f1 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Received unexpected event network-vif-plugged-33605006-0418-423d-b2f9-f7ac03767374 for instance with vm_state active and task_state None.
Nov 14 19:08:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Creating config drive at /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.config
Nov 14 19:08:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfzi4utjl {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfzi4utjl" returned: 0 in 0.097s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:08:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Instance spawned successfully.
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:53 user nova-compute[75205]: INFO nova.compute.manager [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Took 8.22 seconds to spawn the instance on the hypervisor.
Nov 14 19:08:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:08:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Acquiring lock "aa9e5564-b68f-42b4-9263-709641bde28b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "aa9e5564-b68f-42b4-9263-709641bde28b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:08:54 user nova-compute[75205]: INFO nova.compute.manager [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Took 9.76 seconds to build instance.
Nov 14 19:08:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-199cc9a5-6835-4f84-8c62-8c8b8ef49440 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.360s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:54 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:08:54 user nova-compute[75205]: INFO nova.compute.claims [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Claim successful on node user
Nov 14 19:08:54 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:08:54 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:08:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:08:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.policy [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2990f8f4a3a44eeb269b6ab8519c28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c674c3d5fd3405b950d59ecd4372b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Received event network-vif-plugged-33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] Acquiring lock "6e3657fa-d795-4732-852a-158c68452387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] Lock "6e3657fa-d795-4732-852a-158c68452387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] Lock "6e3657fa-d795-4732-852a-158c68452387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] No waiting events found dispatching network-vif-plugged-33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:08:55 user nova-compute[75205]: WARNING nova.compute.manager [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Received unexpected event network-vif-plugged-33605006-0418-423d-b2f9-f7ac03767374 for instance with vm_state active and task_state None.
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:08:55 user nova-compute[75205]: WARNING nova.compute.manager [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state active and task_state None.
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:08:55 user nova-compute[75205]: WARNING nova.compute.manager [req-1dd5ec8f-d7dd-4a8f-b789-ae3f80705655 req-ac86bc10-a1c4-4906-aaa4-757cd744be5b service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state active and task_state None.
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:08:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Creating image(s)
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "/opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "/opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-969af8eb-d401-40a1-b32d-ccf9dbe94c10 req-c4950b2b-b68a-4520-bdd5-86c38f3bf4ec service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-plugged-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-969af8eb-d401-40a1-b32d-ccf9dbe94c10 req-c4950b2b-b68a-4520-bdd5-86c38f3bf4ec service nova] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-969af8eb-d401-40a1-b32d-ccf9dbe94c10 req-c4950b2b-b68a-4520-bdd5-86c38f3bf4ec service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-969af8eb-d401-40a1-b32d-ccf9dbe94c10 req-c4950b2b-b68a-4520-bdd5-86c38f3bf4ec service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-969af8eb-d401-40a1-b32d-ccf9dbe94c10 req-c4950b2b-b68a-4520-bdd5-86c38f3bf4ec service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] No waiting events found dispatching network-vif-plugged-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:08:55 user nova-compute[75205]: WARNING nova.compute.manager [req-969af8eb-d401-40a1-b32d-ccf9dbe94c10 req-c4950b2b-b68a-4520-bdd5-86c38f3bf4ec service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received unexpected event network-vif-plugged-56984858-000b-45d7-a6f0-13dc113e14f6 for instance with vm_state building and task_state spawning.
Nov 14 19:08:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.262s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.263s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "622d19bf-0618-49a9-9f71-b632d9e11301" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk 1073741824" returned: 0 in 0.148s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.426s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Successfully created port: 70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.326s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:08:56 user nova-compute[75205]: INFO nova.compute.claims [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Claim successful on node user
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Cannot resize image /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Ensure instance console log exists: /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:08:57 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Successfully updated port: 70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.policy [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11e8a4105e694b14b530792142351388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3325c3ab571b451da9cffb93069482f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:08:57 user nova-compute[75205]: INFO nova.virt.block_device [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Booting with volume 77e65258-d6ca-4db1-8633-f8f45aa20d76 at /dev/vda
Nov 14 19:08:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Acquiring lock "refresh_cache-aa9e5564-b68f-42b4-9263-709641bde28b" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Acquired lock "refresh_cache-aa9e5564-b68f-42b4-9263-709641bde28b" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-77a56d0c-8693-4420-88eb-b34a284d3e3a req-36d1e63a-39b7-40e5-b6c2-25086eb81f71 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received event network-changed-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-77a56d0c-8693-4420-88eb-b34a284d3e3a req-36d1e63a-39b7-40e5-b6c2-25086eb81f71 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Refreshing instance network info cache due to event network-changed-70eb67c8-84ca-42ce-b702-4699cdbc0dbb. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-77a56d0c-8693-4420-88eb-b34a284d3e3a req-36d1e63a-39b7-40e5-b6c2-25086eb81f71 service nova] Acquiring lock "refresh_cache-aa9e5564-b68f-42b4-9263-709641bde28b" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG os_brick.utils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:08:57 user nova-compute[75205]: INFO oslo.privsep.daemon [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp6_q34avs/privsep.sock']
Nov 14 19:08:57 user sudo[85701]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp6_q34avs/privsep.sock
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:08:57 user sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-8f86bdf8-c7e7-4651-bc9c-b0a37833fcdf req-8e6b88c1-72f4-42b9-af8e-ee461a76d2e5 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-plugged-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8f86bdf8-c7e7-4651-bc9c-b0a37833fcdf req-8e6b88c1-72f4-42b9-af8e-ee461a76d2e5 service nova] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8f86bdf8-c7e7-4651-bc9c-b0a37833fcdf req-8e6b88c1-72f4-42b9-af8e-ee461a76d2e5 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8f86bdf8-c7e7-4651-bc9c-b0a37833fcdf req-8e6b88c1-72f4-42b9-af8e-ee461a76d2e5 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-8f86bdf8-c7e7-4651-bc9c-b0a37833fcdf req-8e6b88c1-72f4-42b9-af8e-ee461a76d2e5 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] No waiting events found dispatching network-vif-plugged-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:08:57 user nova-compute[75205]: WARNING nova.compute.manager [req-8f86bdf8-c7e7-4651-bc9c-b0a37833fcdf req-8e6b88c1-72f4-42b9-af8e-ee461a76d2e5 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received unexpected event network-vif-plugged-56984858-000b-45d7-a6f0-13dc113e14f6 for instance with vm_state building and task_state spawning.
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Updating instance_info_cache with network_info: [{"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:58 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Instance spawned successfully.
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Successfully created port: 7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Releasing lock "refresh_cache-aa9e5564-b68f-42b4-9263-709641bde28b" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Instance network_info: |[{"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-77a56d0c-8693-4420-88eb-b34a284d3e3a req-36d1e63a-39b7-40e5-b6c2-25086eb81f71 service nova] Acquired lock "refresh_cache-aa9e5564-b68f-42b4-9263-709641bde28b" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-77a56d0c-8693-4420-88eb-b34a284d3e3a req-36d1e63a-39b7-40e5-b6c2-25086eb81f71 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Refreshing network info cache for port 70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Start _get_guest_xml network_info=[{"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:08:58 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:58 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2080709883',display_name='tempest-VolumesAssistedSnapshotsTest-server-2080709883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2080709883',id=7,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf3MD4sZUc3DxejQIVaPEkXUPv1HVIWYWzNVdK9vVrbHoLIpqRRkKZTQrris16fx1aUu46nsG0BUFxSl+KYxowCiwgrC8coY3lOCbLb92y5NI+0FAFkzqzc5HbIPQR3hQ==',key_name='tempest-keypair-973369489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c674c3d5fd3405b950d59ecd4372b39',ramdisk_id='',reservation_id='r-ppnbjp6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-553621658',owner_user_name='tempest-VolumesAssistedSnapshotsTest-553621658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2990f8f4a3a44eeb269b6ab8519c28c',uuid=aa9e5564-b68f-42b4-9263-709641bde28b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Converting VIF {"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d7:72,bridge_name='br-int',has_traffic_filtering=True,id=70eb67c8-84ca-42ce-b702-4699cdbc0dbb,network=Network(bff6b6cf-9b2d-4c94-aebc-1c191dd03017),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb67c8-84') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lazy-loading 'pci_devices' on Instance uuid aa9e5564-b68f-42b4-9263-709641bde28b {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:08:58 user nova-compute[75205]:   <uuid>aa9e5564-b68f-42b4-9263-709641bde28b</uuid>
Nov 14 19:08:58 user nova-compute[75205]:   <name>instance-00000007</name>
Nov 14 19:08:58 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:08:58 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:08:58 user nova-compute[75205]:   <metadata>
Nov 14 19:08:58 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:08:58 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:08:58 user nova-compute[75205]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2080709883</nova:name>
Nov 14 19:08:58 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:08:58</nova:creationTime>
Nov 14 19:08:58 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:08:58 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:08:58 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:08:58 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:08:58 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:08:58 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:08:58 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:08:58 user nova-compute[75205]:       <nova:owner>
Nov 14 19:08:58 user nova-compute[75205]:         <nova:user uuid="b2990f8f4a3a44eeb269b6ab8519c28c">tempest-VolumesAssistedSnapshotsTest-553621658-project-member</nova:user>
Nov 14 19:08:58 user nova-compute[75205]:         <nova:project uuid="6c674c3d5fd3405b950d59ecd4372b39">tempest-VolumesAssistedSnapshotsTest-553621658</nova:project>
Nov 14 19:08:58 user nova-compute[75205]:       </nova:owner>
Nov 14 19:08:58 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:08:58 user nova-compute[75205]:       <nova:ports>
Nov 14 19:08:58 user nova-compute[75205]:         <nova:port uuid="70eb67c8-84ca-42ce-b702-4699cdbc0dbb">
Nov 14 19:08:58 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 19:08:58 user nova-compute[75205]:         </nova:port>
Nov 14 19:08:58 user nova-compute[75205]:       </nova:ports>
Nov 14 19:08:58 user nova-compute[75205]:     </nova:instance>
Nov 14 19:08:58 user nova-compute[75205]:   </metadata>
Nov 14 19:08:58 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:08:58 user nova-compute[75205]:     <system>
Nov 14 19:08:58 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:08:58 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:08:58 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:08:58 user nova-compute[75205]:       <entry name="serial">aa9e5564-b68f-42b4-9263-709641bde28b</entry>
Nov 14 19:08:58 user nova-compute[75205]:       <entry name="uuid">aa9e5564-b68f-42b4-9263-709641bde28b</entry>
Nov 14 19:08:58 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:08:58 user nova-compute[75205]:     </system>
Nov 14 19:08:58 user nova-compute[75205]:   </sysinfo>
Nov 14 19:08:58 user nova-compute[75205]:   <os>
Nov 14 19:08:58 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:08:58 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:08:58 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:08:58 user nova-compute[75205]:   </os>
Nov 14 19:08:58 user nova-compute[75205]:   <features>
Nov 14 19:08:58 user nova-compute[75205]:     <acpi/>
Nov 14 19:08:58 user nova-compute[75205]:     <apic/>
Nov 14 19:08:58 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:08:58 user nova-compute[75205]:   </features>
Nov 14 19:08:58 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:08:58 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:08:58 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:08:58 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:08:58 user nova-compute[75205]:   </clock>
Nov 14 19:08:58 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:08:58 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:08:58 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:08:58 user nova-compute[75205]:   </cpu>
Nov 14 19:08:58 user nova-compute[75205]:   <devices>
Nov 14 19:08:58 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:08:58 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:08:58 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk"/>
Nov 14 19:08:58 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:08:58 user nova-compute[75205]:     </disk>
Nov 14 19:08:58 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:08:58 user nova-compute[75205]:       <mac address="fa:16:3e:3d:d7:72"/>
Nov 14 19:08:58 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:58 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:08:58 user nova-compute[75205]:       <target dev="tap70eb67c8-84"/>
Nov 14 19:08:58 user nova-compute[75205]:     </interface>
Nov 14 19:08:58 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:08:58 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/console.log" append="off"/>
Nov 14 19:08:58 user nova-compute[75205]:     </serial>
Nov 14 19:08:58 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:08:58 user nova-compute[75205]:     <video>
Nov 14 19:08:58 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:08:58 user nova-compute[75205]:     </video>
Nov 14 19:08:58 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:08:58 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:08:58 user nova-compute[75205]:     </rng>
Nov 14 19:08:58 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:08:58 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:08:58 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:08:58 user nova-compute[75205]:     </memballoon>
Nov 14 19:08:58 user nova-compute[75205]:   </devices>
Nov 14 19:08:58 user nova-compute[75205]: </domain>
Nov 14 19:08:58 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2080709883',display_name='tempest-VolumesAssistedSnapshotsTest-server-2080709883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2080709883',id=7,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf3MD4sZUc3DxejQIVaPEkXUPv1HVIWYWzNVdK9vVrbHoLIpqRRkKZTQrris16fx1aUu46nsG0BUFxSl+KYxowCiwgrC8coY3lOCbLb92y5NI+0FAFkzqzc5HbIPQR3hQ==',key_name='tempest-keypair-973369489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c674c3d5fd3405b950d59ecd4372b39',ramdisk_id='',reservation_id='r-ppnbjp6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-553621658',owner_user_name='tempest-VolumesAssistedSnapshotsTest-553621658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2990f8f4a3a44eeb269b6ab8519c28c',uuid=aa9e5564-b68f-42b4-9263-709641bde28b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Converting VIF {"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d7:72,bridge_name='br-int',has_traffic_filtering=True,id=70eb67c8-84ca-42ce-b702-4699cdbc0dbb,network=Network(bff6b6cf-9b2d-4c94-aebc-1c191dd03017),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb67c8-84') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG os_vif [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d7:72,bridge_name='br-int',has_traffic_filtering=True,id=70eb67c8-84ca-42ce-b702-4699cdbc0dbb,network=Network(bff6b6cf-9b2d-4c94-aebc-1c191dd03017),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb67c8-84') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88ec9554-75f9-5eee-b4fa-d49db5ed58fd', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:58 user nova-compute[75205]: INFO nova.compute.manager [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Took 8.75 seconds to spawn the instance on the hypervisor.
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70eb67c8-84, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70eb67c8-84, col_values=(('qos', UUID('59e21ab4-ae61-4a4b-ae93-cba3afe5a0c5')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70eb67c8-84, col_values=(('external_ids', {'iface-id': '70eb67c8-84ca-42ce-b702-4699cdbc0dbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:d7:72', 'vm-uuid': 'aa9e5564-b68f-42b4-9263-709641bde28b'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:08:58 user nova-compute[75205]: INFO os_vif [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d7:72,bridge_name='br-int',has_traffic_filtering=True,id=70eb67c8-84ca-42ce-b702-4699cdbc0dbb,network=Network(bff6b6cf-9b2d-4c94-aebc-1c191dd03017),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb67c8-84')
Nov 14 19:08:58 user nova-compute[75205]: INFO nova.compute.manager [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Took 9.87 seconds to build instance.
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] No VIF found with MAC fa:16:3e:3d:d7:72, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-38140948-89c9-433d-9fac-7668357a2bcd tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.052s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-77a56d0c-8693-4420-88eb-b34a284d3e3a req-36d1e63a-39b7-40e5-b6c2-25086eb81f71 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Updated VIF entry in instance network info cache for port 70eb67c8-84ca-42ce-b702-4699cdbc0dbb. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-77a56d0c-8693-4420-88eb-b34a284d3e3a req-36d1e63a-39b7-40e5-b6c2-25086eb81f71 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Updating instance_info_cache with network_info: [{"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-77a56d0c-8693-4420-88eb-b34a284d3e3a req-36d1e63a-39b7-40e5-b6c2-25086eb81f71 service nova] Releasing lock "refresh_cache-aa9e5564-b68f-42b4-9263-709641bde28b" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Successfully updated port: 7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "refresh_cache-622d19bf-0618-49a9-9f71-b632d9e11301" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquired lock "refresh_cache-622d19bf-0618-49a9-9f71-b632d9e11301" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:08:59 user sudo[85701]: pam_unix(sudo:session): session closed for user root
Nov 14 19:08:59 user nova-compute[75205]: INFO oslo.privsep.daemon [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Spawned new privsep daemon via rootwrap
Nov 14 19:08:59 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 19:08:59 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 19:08:59 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 19:08:59 user nova-compute[75205]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85714
Nov 14 19:08:59 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Updating instance_info_cache with network_info: [{"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Releasing lock "refresh_cache-622d19bf-0618-49a9-9f71-b632d9e11301" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Instance network_info: |[{"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93d931d-e3a7-4093-b835-eb15bf419e8d]: (2,) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f52ca45-0fea-4c9b-a42d-08889f6cdfa4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:08:59 user nova-compute[75205]: WARNING os_brick.initiator.connectors.nvmeof [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39e30a9-4fc4-42ab-870e-ffeac2555009]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[656d3868-dc0a-4a06-a7d5-66acf65dd59e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a51f503-a2d1-444c-a479-fb21a3c16a0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:08:59 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcda585-390d-4f20-91ed-c466ad8787db]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG os_brick.utils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] <== get_connector_properties: return (2133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Updating existing volume attachment record: a6df05fc-86e0-412f-a978-b3d66335c84c {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8697c3f-5ff0-4bb9-9fb8-1a421fe2fdb4 req-b5fc01bf-02b8-4208-b8de-a800c8f04382 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-changed-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8697c3f-5ff0-4bb9-9fb8-1a421fe2fdb4 req-b5fc01bf-02b8-4208-b8de-a800c8f04382 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Refreshing instance network info cache due to event network-changed-7fc6ede6-60c6-4440-a719-9397a8437fbb. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8697c3f-5ff0-4bb9-9fb8-1a421fe2fdb4 req-b5fc01bf-02b8-4208-b8de-a800c8f04382 service nova] Acquiring lock "refresh_cache-622d19bf-0618-49a9-9f71-b632d9e11301" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8697c3f-5ff0-4bb9-9fb8-1a421fe2fdb4 req-b5fc01bf-02b8-4208-b8de-a800c8f04382 service nova] Acquired lock "refresh_cache-622d19bf-0618-49a9-9f71-b632d9e11301" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:08:59 user nova-compute[75205]: DEBUG nova.network.neutron [req-c8697c3f-5ff0-4bb9-9fb8-1a421fe2fdb4 req-b5fc01bf-02b8-4208-b8de-a800c8f04382 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Refreshing network info cache for port 7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:09:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:00 user nova-compute[75205]: DEBUG nova.network.neutron [req-c8697c3f-5ff0-4bb9-9fb8-1a421fe2fdb4 req-b5fc01bf-02b8-4208-b8de-a800c8f04382 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Updated VIF entry in instance network info cache for port 7fc6ede6-60c6-4440-a719-9397a8437fbb. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:09:00 user nova-compute[75205]: DEBUG nova.network.neutron [req-c8697c3f-5ff0-4bb9-9fb8-1a421fe2fdb4 req-b5fc01bf-02b8-4208-b8de-a800c8f04382 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Updating instance_info_cache with network_info: [{"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8697c3f-5ff0-4bb9-9fb8-1a421fe2fdb4 req-b5fc01bf-02b8-4208-b8de-a800c8f04382 service nova] Releasing lock "refresh_cache-622d19bf-0618-49a9-9f71-b632d9e11301" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:09:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:09:02 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Instance spawned successfully.
Nov 14 19:09:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:09:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:02 user nova-compute[75205]: INFO nova.compute.manager [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Took 7.29 seconds to spawn the instance on the hypervisor.
Nov 14 19:09:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:09:03 user nova-compute[75205]: INFO nova.compute.manager [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Took 8.82 seconds to build instance.
Nov 14 19:09:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f5dbcc-d91c-4f00-8bdf-e5d886707ba3 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "aa9e5564-b68f-42b4-9263-709641bde28b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.099s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:09:06 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Creating image(s)
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Ensure instance console log exists: /opt/stack/data/nova/instances/622d19bf-0618-49a9-9f71-b632d9e11301/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Start _get_guest_xml network_info=[{"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epHdMIaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '622d19bf-0618-49a9-9f71-b632d9e11301', 'attached_at': '', 'detached_at': '', 'volume_id': '77e65258-d6ca-4db1-8633-f8f45aa20d76', 'serial': '77e65258-d6ca-4db1-8633-f8f45aa20d76'}, 'attachment_id': 'a6df05fc-86e0-412f-a978-b3d66335c84c', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:09:06 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:09:06 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connector [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Factory for ISCSI on None {{(pid=75205) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epHdMIaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:09:06 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:09:06 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:09:06 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca12fd7b-773b-44d7-9fdd-e2f292b5a8fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:09:06 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d24b6f3-c870-491d-9895-c7547e3ad706]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76] added
Nov 14 19:09:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2648dc-e09a-4e46-902c-1749514df680]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[49968cc2-2c76-4cc1-8ef6-7b4425d25219]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epHdMIaN {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epHdMIaN" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[632959f5-8cca-49e5-83c8-6fea0644aac6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'epHdMIaN'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cdf320-9210-4d2b-9663-93440cd84b15]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e3a118-b3c6-4925-9876-b5c716fcebc0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:09:06 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:09:06 user nova-compute[75205]:  {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:09:06 user nova-compute[75205]: WARNING os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 19:09:06 user nova-compute[75205]: 
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aff9ee7-e290-4a93-b72f-c09bbabc2827]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260]
Nov 14 19:09:06 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260] successful.
Nov 14 19:09:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[255ec678-6066-4bcb-a93c-5104b7f05c01]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbe60b3-1513-4036-aa7b-165e708b0e76]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f614964-4f66-439f-974d-53a7ad337676]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:09:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epHdMIaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:09:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:09:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23630623530336561', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:09:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630623530336561', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-266304409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-266304409',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuroo777PzrJhNT1Z+8Bz3bmZfqCc+/PXCXIZcuctFMhrY1Rpfi1QfSM9QpIJtELl/C4MHfcfyzeOJ7oaOGYkNsgfsiChX3EizTbvsbrCm3XCIgNnKEPubgbl6oglzwDw==',key_name='tempest-keypair-1647726640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3325c3ab571b451da9cffb93069482f5',ramdisk_id='',reservation_id='r-7uy2l8c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-667072902',owner_user_name='tempest-ServerActionsV293TestJSON-667072902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11e8a4105e694b14b530792142351388',uuid=622d19bf-0618-49a9-9f71-b632d9e11301,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converting VIF {"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lazy-loading 'pci_devices' on Instance uuid 622d19bf-0618-49a9-9f71-b632d9e11301 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:09:08 user nova-compute[75205]:   <uuid>622d19bf-0618-49a9-9f71-b632d9e11301</uuid>
Nov 14 19:09:08 user nova-compute[75205]:   <name>instance-00000008</name>
Nov 14 19:09:08 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:09:08 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:09:08 user nova-compute[75205]:   <metadata>
Nov 14 19:09:08 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:09:08 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:09:08 user nova-compute[75205]:       <nova:name>tempest-ServerActionsV293TestJSON-server-266304409</nova:name>
Nov 14 19:09:08 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:09:06</nova:creationTime>
Nov 14 19:09:08 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:09:08 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:09:08 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:09:08 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:09:08 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:09:08 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:09:08 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:09:08 user nova-compute[75205]:       <nova:owner>
Nov 14 19:09:08 user nova-compute[75205]:         <nova:user uuid="11e8a4105e694b14b530792142351388">tempest-ServerActionsV293TestJSON-667072902-project-member</nova:user>
Nov 14 19:09:08 user nova-compute[75205]:         <nova:project uuid="3325c3ab571b451da9cffb93069482f5">tempest-ServerActionsV293TestJSON-667072902</nova:project>
Nov 14 19:09:08 user nova-compute[75205]:       </nova:owner>
Nov 14 19:09:08 user nova-compute[75205]:       <nova:ports>
Nov 14 19:09:08 user nova-compute[75205]:         <nova:port uuid="7fc6ede6-60c6-4440-a719-9397a8437fbb">
Nov 14 19:09:08 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:09:08 user nova-compute[75205]:         </nova:port>
Nov 14 19:09:08 user nova-compute[75205]:       </nova:ports>
Nov 14 19:09:08 user nova-compute[75205]:     </nova:instance>
Nov 14 19:09:08 user nova-compute[75205]:   </metadata>
Nov 14 19:09:08 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:09:08 user nova-compute[75205]:     <system>
Nov 14 19:09:08 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:09:08 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:09:08 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:09:08 user nova-compute[75205]:       <entry name="serial">622d19bf-0618-49a9-9f71-b632d9e11301</entry>
Nov 14 19:09:08 user nova-compute[75205]:       <entry name="uuid">622d19bf-0618-49a9-9f71-b632d9e11301</entry>
Nov 14 19:09:08 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:09:08 user nova-compute[75205]:     </system>
Nov 14 19:09:08 user nova-compute[75205]:   </sysinfo>
Nov 14 19:09:08 user nova-compute[75205]:   <os>
Nov 14 19:09:08 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:09:08 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:09:08 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:09:08 user nova-compute[75205]:   </os>
Nov 14 19:09:08 user nova-compute[75205]:   <features>
Nov 14 19:09:08 user nova-compute[75205]:     <acpi/>
Nov 14 19:09:08 user nova-compute[75205]:     <apic/>
Nov 14 19:09:08 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:09:08 user nova-compute[75205]:   </features>
Nov 14 19:09:08 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:09:08 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:09:08 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:09:08 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:09:08 user nova-compute[75205]:   </clock>
Nov 14 19:09:08 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:09:08 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:09:08 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:09:08 user nova-compute[75205]:   </cpu>
Nov 14 19:09:08 user nova-compute[75205]:   <devices>
Nov 14 19:09:08 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:09:08 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:09:08 user nova-compute[75205]:       <source dev="/dev/sdb"/>
Nov 14 19:09:08 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:09:08 user nova-compute[75205]:       <serial>77e65258-d6ca-4db1-8633-f8f45aa20d76</serial>
Nov 14 19:09:08 user nova-compute[75205]:     </disk>
Nov 14 19:09:08 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:09:08 user nova-compute[75205]:       <mac address="fa:16:3e:2f:65:53"/>
Nov 14 19:09:08 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:08 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:09:08 user nova-compute[75205]:       <target dev="tap7fc6ede6-60"/>
Nov 14 19:09:08 user nova-compute[75205]:     </interface>
Nov 14 19:09:08 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:09:08 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/622d19bf-0618-49a9-9f71-b632d9e11301/console.log" append="off"/>
Nov 14 19:09:08 user nova-compute[75205]:     </serial>
Nov 14 19:09:08 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:09:08 user nova-compute[75205]:     <video>
Nov 14 19:09:08 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:08 user nova-compute[75205]:     </video>
Nov 14 19:09:08 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:09:08 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:09:08 user nova-compute[75205]:     </rng>
Nov 14 19:09:08 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:09:08 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:09:08 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:09:08 user nova-compute[75205]:     </memballoon>
Nov 14 19:09:08 user nova-compute[75205]:   </devices>
Nov 14 19:09:08 user nova-compute[75205]: </domain>
Nov 14 19:09:08 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-266304409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-266304409',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuroo777PzrJhNT1Z+8Bz3bmZfqCc+/PXCXIZcuctFMhrY1Rpfi1QfSM9QpIJtELl/C4MHfcfyzeOJ7oaOGYkNsgfsiChX3EizTbvsbrCm3XCIgNnKEPubgbl6oglzwDw==',key_name='tempest-keypair-1647726640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3325c3ab571b451da9cffb93069482f5',ramdisk_id='',reservation_id='r-7uy2l8c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-667072902',owner_user_name='tempest-ServerActionsV293TestJSON-667072902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11e8a4105e694b14b530792142351388',uuid=622d19bf-0618-49a9-9f71-b632d9e11301,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converting VIF {"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG os_vif [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac377cf3-eecc-5d42-9f72-cee3387d32c2', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fc6ede6-60, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fc6ede6-60, col_values=(('qos', UUID('b733430f-4b60-4fd3-951b-326a5332bf6a')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fc6ede6-60, col_values=(('external_ids', {'iface-id': '7fc6ede6-60c6-4440-a719-9397a8437fbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:65:53', 'vm-uuid': '622d19bf-0618-49a9-9f71-b632d9e11301'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:08 user nova-compute[75205]: INFO os_vif [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60')
Nov 14 19:09:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:09:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] No VIF found with MAC fa:16:3e:2f:65:53, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:09:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-979ec03c-bcb2-4e6b-a4ee-5aa54823522c req-c6f5d3b0-3bb3-4da7-9aa3-86de348259ca service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-979ec03c-bcb2-4e6b-a4ee-5aa54823522c req-c6f5d3b0-3bb3-4da7-9aa3-86de348259ca service nova] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-979ec03c-bcb2-4e6b-a4ee-5aa54823522c req-c6f5d3b0-3bb3-4da7-9aa3-86de348259ca service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-979ec03c-bcb2-4e6b-a4ee-5aa54823522c req-c6f5d3b0-3bb3-4da7-9aa3-86de348259ca service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-979ec03c-bcb2-4e6b-a4ee-5aa54823522c req-c6f5d3b0-3bb3-4da7-9aa3-86de348259ca service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] No waiting events found dispatching network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:10 user nova-compute[75205]: WARNING nova.compute.manager [req-979ec03c-bcb2-4e6b-a4ee-5aa54823522c req-c6f5d3b0-3bb3-4da7-9aa3-86de348259ca service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received unexpected event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb for instance with vm_state building and task_state spawning.
Nov 14 19:09:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:09:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Instance spawned successfully.
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:12 user nova-compute[75205]: INFO nova.compute.manager [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "7d9eda42-5048-4838-820b-45844f8e59b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:09:12 user nova-compute[75205]: INFO nova.compute.manager [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Took 15.64 seconds to build instance.
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b7fcfb5e-6103-44be-af73-5ac611981a88 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "622d19bf-0618-49a9-9f71-b632d9e11301" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.064s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:09:12 user nova-compute[75205]: INFO nova.compute.claims [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Claim successful on node user
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-5c49f386-08c5-483f-9aaa-4ec6b79a458c req-c338d62e-8708-4c11-ace1-4be8b73fcf53 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5c49f386-08c5-483f-9aaa-4ec6b79a458c req-c338d62e-8708-4c11-ace1-4be8b73fcf53 service nova] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5c49f386-08c5-483f-9aaa-4ec6b79a458c req-c338d62e-8708-4c11-ace1-4be8b73fcf53 service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5c49f386-08c5-483f-9aaa-4ec6b79a458c req-c338d62e-8708-4c11-ace1-4be8b73fcf53 service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-5c49f386-08c5-483f-9aaa-4ec6b79a458c req-c338d62e-8708-4c11-ace1-4be8b73fcf53 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] No waiting events found dispatching network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:12 user nova-compute[75205]: WARNING nova.compute.manager [req-5c49f386-08c5-483f-9aaa-4ec6b79a458c req-c338d62e-8708-4c11-ace1-4be8b73fcf53 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received unexpected event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb for instance with vm_state active and task_state None.
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-88f9a318-2876-4987-8be5-b40751113737 req-5e4d4892-f5f0-4cf6-afb3-504575a8f326 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received event network-vif-plugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88f9a318-2876-4987-8be5-b40751113737 req-5e4d4892-f5f0-4cf6-afb3-504575a8f326 service nova] Acquiring lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88f9a318-2876-4987-8be5-b40751113737 req-5e4d4892-f5f0-4cf6-afb3-504575a8f326 service nova] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88f9a318-2876-4987-8be5-b40751113737 req-5e4d4892-f5f0-4cf6-afb3-504575a8f326 service nova] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-88f9a318-2876-4987-8be5-b40751113737 req-5e4d4892-f5f0-4cf6-afb3-504575a8f326 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] No waiting events found dispatching network-vif-plugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:12 user nova-compute[75205]: WARNING nova.compute.manager [req-88f9a318-2876-4987-8be5-b40751113737 req-5e4d4892-f5f0-4cf6-afb3-504575a8f326 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received unexpected event network-vif-plugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc for instance with vm_state active and task_state None.
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:09:12 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:09:13 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:09:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:13 user nova-compute[75205]: INFO nova.virt.block_device [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Booting with volume a062f787-b1d4-4d3a-81e8-1de96f792979 at /dev/vda
Nov 14 19:09:13 user nova-compute[75205]: DEBUG nova.policy [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36bc4083ea9e4f198fc96919c15b0336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67951a7beaa640758b17efd600d5a65c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG os_brick.utils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbd00af-f329-4991-aef7-1b88625fd22e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[58208e6e-0a67-43e5-8572-8fbd3ba5b897]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54b8e4e-c8a9-453b-81e7-330042f18609]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a700c5-0d66-4ef2-aeeb-2c394af927ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:09:13 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:09:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d63f14a-dcba-43a2-aa65-00d224b58f6c]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG os_brick.utils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:09:13 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating existing volume attachment record: 47ed74d2-e688-49a6-954f-391c207b50bb {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully created port: 6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully created port: 409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received event network-vif-plugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] Acquiring lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] No waiting events found dispatching network-vif-plugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:14 user nova-compute[75205]: WARNING nova.compute.manager [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received unexpected event network-vif-plugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc for instance with vm_state active and task_state None.
Nov 14 19:09:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received event network-vif-plugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] Acquiring lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] Lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] Lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] No waiting events found dispatching network-vif-plugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:14 user nova-compute[75205]: WARNING nova.compute.manager [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received unexpected event network-vif-plugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb for instance with vm_state active and task_state None.
Nov 14 19:09:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received event network-vif-plugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] Acquiring lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] Lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] Lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] No waiting events found dispatching network-vif-plugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:14 user nova-compute[75205]: WARNING nova.compute.manager [req-a06656a8-2c1a-4db5-9ab6-1f3b8f176268 req-154753ef-9c4f-4780-becd-d883fc44686f service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received unexpected event network-vif-plugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb for instance with vm_state active and task_state None.
Nov 14 19:09:15 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully created port: 4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:09:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 19:09:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] There are 0 instances to clean {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 19:09:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75205) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 19:09:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:15 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully created port: c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:09:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:16 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully created port: 4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:09:17 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully updated port: 6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:09:17 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:09:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8c18506-3a3e-4307-9104-21115cd1e078 req-2f11ccfc-ada2-45fe-9b9c-e1d815a223b0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-changed-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8c18506-3a3e-4307-9104-21115cd1e078 req-2f11ccfc-ada2-45fe-9b9c-e1d815a223b0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing instance network info cache due to event network-changed-6ca76c67-3d07-45f3-b07f-5c997c4392d4. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:09:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8c18506-3a3e-4307-9104-21115cd1e078 req-2f11ccfc-ada2-45fe-9b9c-e1d815a223b0 service nova] Acquiring lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8c18506-3a3e-4307-9104-21115cd1e078 req-2f11ccfc-ada2-45fe-9b9c-e1d815a223b0 service nova] Acquired lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:17 user nova-compute[75205]: DEBUG nova.network.neutron [req-f8c18506-3a3e-4307-9104-21115cd1e078 req-2f11ccfc-ada2-45fe-9b9c-e1d815a223b0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing network info cache for port 6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:09:17 user nova-compute[75205]: DEBUG nova.network.neutron [req-f8c18506-3a3e-4307-9104-21115cd1e078 req-2f11ccfc-ada2-45fe-9b9c-e1d815a223b0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully updated port: f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG nova.network.neutron [req-f8c18506-3a3e-4307-9104-21115cd1e078 req-2f11ccfc-ada2-45fe-9b9c-e1d815a223b0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8c18506-3a3e-4307-9104-21115cd1e078 req-2f11ccfc-ada2-45fe-9b9c-e1d815a223b0 service nova] Releasing lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Skipping network cache update for instance because it is Building. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-f185f08b-ea86-40f4-af2b-95badfddca27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-f185f08b-ea86-40f4-af2b-95badfddca27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid f185f08b-ea86-40f4-af2b-95badfddca27 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:09:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully updated port: b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Updating instance_info_cache with network_info: [{"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-f185f08b-ea86-40f4-af2b-95badfddca27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-changed-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing instance network info cache due to event network-changed-f0a2b257-cbd8-45df-8fa6-b25c8c22d129. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] Acquiring lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] Acquired lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing network info cache for port f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully updated port: 409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7370e9d-6c1a-4593-9224-35b8375080cf req-a85532bf-0849-42bb-b34f-fdd5bcbbb681 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-changed-409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7370e9d-6c1a-4593-9224-35b8375080cf req-a85532bf-0849-42bb-b34f-fdd5bcbbb681 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing instance network info cache due to event network-changed-409075c5-56a9-4921-b141-1e30e8cebc9f. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7370e9d-6c1a-4593-9224-35b8375080cf req-a85532bf-0849-42bb-b34f-fdd5bcbbb681 service nova] Acquiring lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:19 user nova-compute[75205]: INFO nova.virt.block_device [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Booting with volume e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb at /dev/vdb
Nov 14 19:09:19 user nova-compute[75205]: DEBUG os_brick.utils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf177b5-edfa-4b09-aa7b-f0db19773e93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec1693e-4c56-4481-b7a4-8d71a8128dc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ccbd82-3c8f-4aee-b70d-b000da043790]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be53295-1c78-4083-913b-810b3cd65954]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:09:20 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a9c709-dec2-4a0a-a88b-e6630f80a1c8]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG os_brick.utils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] <== get_connector_properties: return (208ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating existing volume attachment record: 175a498a-b5e6-4fb6-9b6f-ecb4dfee7a16 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG nova.network.neutron [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] Releasing lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-changed-b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing instance network info cache due to event network-changed-b82bff6e-beb2-4812-9927-0e5ba4fc1101. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] Acquiring lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] Acquired lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG nova.network.neutron [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing network info cache for port b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG nova.network.neutron [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully updated port: 4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG nova.network.neutron [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c6416f73-ed88-4076-b1a8-aa5c73280d15 req-8d71b0fc-cb91-4338-ab8e-169220916fea service nova] Releasing lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7370e9d-6c1a-4593-9224-35b8375080cf req-a85532bf-0849-42bb-b34f-fdd5bcbbb681 service nova] Acquired lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG nova.network.neutron [req-c7370e9d-6c1a-4593-9224-35b8375080cf req-a85532bf-0849-42bb-b34f-fdd5bcbbb681 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing network info cache for port 409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG nova.network.neutron [req-c7370e9d-6c1a-4593-9224-35b8375080cf req-a85532bf-0849-42bb-b34f-fdd5bcbbb681 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-c7370e9d-6c1a-4593-9224-35b8375080cf req-a85532bf-0849-42bb-b34f-fdd5bcbbb681 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7370e9d-6c1a-4593-9224-35b8375080cf req-a85532bf-0849-42bb-b34f-fdd5bcbbb681 service nova] Releasing lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully updated port: c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-changed-4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing instance network info cache due to event network-changed-4b2e49ca-5b36-4020-82b5-6e755b1795fd. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] Acquiring lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] Acquired lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing network info cache for port 4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Successfully updated port: 4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] Releasing lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-changed-c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing instance network info cache due to event network-changed-c3895efd-2875-45b4-a318-ac6b9d2149c2. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] Acquiring lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] Acquired lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing network info cache for port c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:22 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:09:22 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:09:22 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7400MB free_disk=25.62012481689453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4020af70-58bf-492a-9fe1-38939cc6812e req-b4287413-874f-4bdc-a84c-67fbc3a32b9b service nova] Releasing lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquired lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:22 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance f185f08b-ea86-40f4-af2b-95badfddca27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1f24f442-1547-4f20-ba7c-f7790dcc37af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance b2696233-b1c2-466d-92f1-0a30c3db1501 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance aa9e5564-b68f-42b4-9263-709641bde28b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 622d19bf-0618-49a9-9f71-b632d9e11301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7d9eda42-5048-4838-820b-45844f8e59b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.862s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-45912df5-639e-4ba4-a164-b2135745abdf req-c56d9cc1-4723-4ff0-ba7c-9359781ce399 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-changed-4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-45912df5-639e-4ba4-a164-b2135745abdf req-c56d9cc1-4723-4ff0-ba7c-9359781ce399 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing instance network info cache due to event network-changed-4c9e16ea-3c98-4988-8101-527a7cd92765. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-45912df5-639e-4ba4-a164-b2135745abdf req-c56d9cc1-4723-4ff0-ba7c-9359781ce399 service nova] Acquiring lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:23 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [{"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Releasing lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG nova.compute.manager [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance network_info: |[{"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-45912df5-639e-4ba4-a164-b2135745abdf req-c56d9cc1-4723-4ff0-ba7c-9359781ce399 service nova] Acquired lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG nova.network.neutron [req-45912df5-639e-4ba4-a164-b2135745abdf req-c56d9cc1-4723-4ff0-ba7c-9359781ce399 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing network info cache for port 4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:09:25 user nova-compute[75205]: INFO nova.virt.block_device [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Booting with volume 6c21ab44-d890-463a-bf92-4245f30259b6 at /dev/vdc
Nov 14 19:09:25 user nova-compute[75205]: DEBUG os_brick.utils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ae2009-4e01-4a5e-a4a5-27988818db59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd433c4-d16e-4bc1-a485-22059dc8946a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cf5f0e-6602-4e0b-8341-f8b553b8315a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03dddf1-036a-44cd-a955-e025f8c19722]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:09:25 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae590364-371f-4c83-9587-bfd56ce70696]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG os_brick.utils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating existing volume attachment record: 6dbb5831-ad50-4fab-8e0f-a30fb16169d0 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG nova.network.neutron [req-45912df5-639e-4ba4-a164-b2135745abdf req-c56d9cc1-4723-4ff0-ba7c-9359781ce399 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updated VIF entry in instance network info cache for port 4c9e16ea-3c98-4988-8101-527a7cd92765. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG nova.network.neutron [req-45912df5-639e-4ba4-a164-b2135745abdf req-c56d9cc1-4723-4ff0-ba7c-9359781ce399 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [{"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-45912df5-639e-4ba4-a164-b2135745abdf req-c56d9cc1-4723-4ff0-ba7c-9359781ce399 service nova] Releasing lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.compute.manager [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:09:33 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Creating image(s)
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Ensure instance console log exists: /opt/stack/data/nova/instances/7d9eda42-5048-4838-820b-45844f8e59b0/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Start _get_guest_xml network_info=[{"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwXMcKyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d9eda42-5048-4838-820b-45844f8e59b0', 'attached_at': '', 'detached_at': '', 'volume_id': 'a062f787-b1d4-4d3a-81e8-1de96f792979', 'serial': 'a062f787-b1d4-4d3a-81e8-1de96f792979'}, 'attachment_id': '47ed74d2-e688-49a6-954f-391c207b50bb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None}, {'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBkyxsJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d9eda42-5048-4838-820b-45844f8e59b0', 'attached_at': '', 'detached_at': '', 'volume_id': 'e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb', 'serial': 'e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb'}, 'attachment_id': '175a498a-b5e6-4fb6-9b6f-ecb4dfee7a16', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'volume_type': None}, {'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRXiOIca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d9eda42-5048-4838-820b-45844f8e59b0', 'attached_at': '', 'detached_at': '', 'volume_id': '6c21ab44-d890-463a-bf92-4245f30259b6', 'serial': '6c21ab44-d890-463a-bf92-4245f30259b6'}, 'attachment_id': '6dbb5831-ad50-4fab-8e0f-a30fb16169d0', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:09:33 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:09:33 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwXMcKyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:09:33 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:09:33 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:09:33 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4567e2-15d4-4706-ac37-06b25fadc416]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:09:33 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[98027f7f-f76e-4508-95d7-c2fd5e0e02e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979] added
Nov 14 19:09:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d351f7-ba74-435a-a428-611137730318]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7e4e7a-99e3-4361-adf4-966483e91ddc]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwXMcKyo {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwXMcKyo" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4f4a75-ee2b-4332-8e66-ba28844d5259]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zwXMcKyo'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b96f821-33cb-47e1-a75a-a9c71fff792a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8791ffbb-238b-4dfa-a112-6fa98fa1ee61]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10b34b4-d0cc-4c92-aea4-ef3f9c614b1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979, portal: 172.16.0.220,3260]
Nov 14 19:09:33 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979, portal: 172.16.0.220,3260] successful.
Nov 14 19:09:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[50db10e1-4a39-40a9-80ea-ff54172413d7]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[126071dc-1738-4842-9c3f-218b5399336b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:33 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:33 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[deada377-2f11-429e-aeff-23420ec46e2c]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:09:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwXMcKyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:09:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:09:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23434343563623732', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:09:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434343563623732', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:09:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:09:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBkyxsJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:09:34 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:09:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:09:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:09:34 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:09:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:09:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:09:34 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:09:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bace916a-d064-4dde-91e3-1dd70d075a09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:09:35 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe121b8f-d966-4234-a363-5d430ae931cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb] added
Nov 14 19:09:35 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbba293-8c6c-48cc-9881-878018cffdec]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b01968-a65c-469c-874b-00e3f76243ab]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dBkyxsJC {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dBkyxsJC" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd136842-f161-49c6-a920-7c2bba4c23d8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dBkyxsJC'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[233d1d83-796c-4ef7-8935-1a5d200aad5f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[03061deb-876a-4ec3-a905-82c0b5c068ce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:35 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:35 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:35 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:35 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bad488a-dd2b-4e26-aca2-8417a4362d62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb, portal: 172.16.0.220,3260]
Nov 14 19:09:35 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb, portal: 172.16.0.220,3260] successful.
Nov 14 19:09:35 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bece0344-952f-4e19-b4ee-166978a21d7b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c384f7-9796-4ab4-9c93-5606bbbbb02e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:35 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:35 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:09:35 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:35 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:35 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:09:35 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[984e7e45-4bd8-47ba-a32b-2e64999b1c0f]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBkyxsJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:09:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23030613338613336', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030613338613336', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRXiOIca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:09:36 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:09:36 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:09:36 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e00d98-ff1b-4cb3-bb48-2776069127d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:09:36 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ce231b-673b-4600-b3f3-45eee79607fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6] added
Nov 14 19:09:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.119s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[195cf667-8b86-4d28-a06a-d7399ca10fff]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0c8738-b719-4bd3-9f92-0561fa14fea7]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRXiOIca {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRXiOIca" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7589f7d-da13-453a-9cfe-448b20f3faec]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YRXiOIca'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e0422f-af36-435b-86f7-711905c257ba]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd16d46f-fbc6-49ef-b27d-df07949b5bb1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:36 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:36 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:09:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:36 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:36 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:09:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf5c4e9-5e43-4669-930c-b6b4176022f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6, portal: 172.16.0.220,3260]
Nov 14 19:09:36 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6, portal: 172.16.0.220,3260] successful.
Nov 14 19:09:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[61751c1d-e9bd-45e5-8aa0-2535335dedc4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[55598e02-f4c4-49ed-b0f6-e2d0da3700de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:36 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:36 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:09:36 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:09:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:36 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:36 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:09:36 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:09:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8daa1c-64b3-441f-9267-947b14dd20c7]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:36 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRXiOIca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26436643734376133', 'path': '/dev/sde'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436643734376133', 'path': '/dev/sde'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:45:34,bridge_name='br-int',has_traffic_filtering=True,id=6ca76c67-3d07-45f3-b07f-5c997c4392d4,network=Network(23fcee45-779d-4b5f-9599-1a91c0f3f58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca76c67-3d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:55:34,bridge_name='br-int',has_traffic_filtering=True,id=f0a2b257-cbd8-45df-8fa6-b25c8c22d129,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0a2b257-cb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:a4:73,bridge_name='br-int',has_traffic_filtering=True,id=b82bff6e-beb2-4812-9927-0e5ba4fc1101,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb82bff6e-be') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:a5,bridge_name='br-int',has_traffic_filtering=True,id=409075c5-56a9-4921-b141-1e30e8cebc9f,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409075c5-56') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ac:b3,bridge_name='br-int',has_traffic_filtering=True,id=4b2e49ca-5b36-4020-82b5-6e755b1795fd,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2e49ca-5b') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:31,bridge_name='br-int',has_traffic_filtering=True,id=c3895efd-2875-45b4-a318-ac6b9d2149c2,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3895efd-28') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=4c9e16ea-3c98-4988-8101-527a7cd92765,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9e16ea-3c') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.objects.instance [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d9eda42-5048-4838-820b-45844f8e59b0 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:09:37 user nova-compute[75205]:   <uuid>7d9eda42-5048-4838-820b-45844f8e59b0</uuid>
Nov 14 19:09:37 user nova-compute[75205]:   <name>instance-00000009</name>
Nov 14 19:09:37 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:09:37 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:09:37 user nova-compute[75205]:   <metadata>
Nov 14 19:09:37 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:09:37 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:09:37 user nova-compute[75205]:       <nova:name>tempest-device-tagging-server-620967480</nova:name>
Nov 14 19:09:37 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:09:33</nova:creationTime>
Nov 14 19:09:37 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:09:37 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:09:37 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:09:37 user nova-compute[75205]:       <nova:owner>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:user uuid="36bc4083ea9e4f198fc96919c15b0336">tempest-TaggedBootDevicesTest_v242-192411437-project-member</nova:user>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:project uuid="67951a7beaa640758b17efd600d5a65c">tempest-TaggedBootDevicesTest_v242-192411437</nova:project>
Nov 14 19:09:37 user nova-compute[75205]:       </nova:owner>
Nov 14 19:09:37 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:09:37 user nova-compute[75205]:       <nova:ports>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:port uuid="6ca76c67-3d07-45f3-b07f-5c997c4392d4">
Nov 14 19:09:37 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 19:09:37 user nova-compute[75205]:         </nova:port>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:port uuid="f0a2b257-cbd8-45df-8fa6-b25c8c22d129">
Nov 14 19:09:37 user nova-compute[75205]:           <nova:ip type="fixed" address="10.1.1.84" ipVersion="4"/>
Nov 14 19:09:37 user nova-compute[75205]:         </nova:port>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:port uuid="b82bff6e-beb2-4812-9927-0e5ba4fc1101">
Nov 14 19:09:37 user nova-compute[75205]:           <nova:ip type="fixed" address="10.1.1.178" ipVersion="4"/>
Nov 14 19:09:37 user nova-compute[75205]:         </nova:port>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:port uuid="409075c5-56a9-4921-b141-1e30e8cebc9f">
Nov 14 19:09:37 user nova-compute[75205]:           <nova:ip type="fixed" address="10.1.1.140" ipVersion="4"/>
Nov 14 19:09:37 user nova-compute[75205]:         </nova:port>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:port uuid="4b2e49ca-5b36-4020-82b5-6e755b1795fd">
Nov 14 19:09:37 user nova-compute[75205]:           <nova:ip type="fixed" address="10.1.1.95" ipVersion="4"/>
Nov 14 19:09:37 user nova-compute[75205]:         </nova:port>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:port uuid="c3895efd-2875-45b4-a318-ac6b9d2149c2">
Nov 14 19:09:37 user nova-compute[75205]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 19:09:37 user nova-compute[75205]:         </nova:port>
Nov 14 19:09:37 user nova-compute[75205]:         <nova:port uuid="4c9e16ea-3c98-4988-8101-527a7cd92765">
Nov 14 19:09:37 user nova-compute[75205]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 19:09:37 user nova-compute[75205]:         </nova:port>
Nov 14 19:09:37 user nova-compute[75205]:       </nova:ports>
Nov 14 19:09:37 user nova-compute[75205]:     </nova:instance>
Nov 14 19:09:37 user nova-compute[75205]:   </metadata>
Nov 14 19:09:37 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:09:37 user nova-compute[75205]:     <system>
Nov 14 19:09:37 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:09:37 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:09:37 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:09:37 user nova-compute[75205]:       <entry name="serial">7d9eda42-5048-4838-820b-45844f8e59b0</entry>
Nov 14 19:09:37 user nova-compute[75205]:       <entry name="uuid">7d9eda42-5048-4838-820b-45844f8e59b0</entry>
Nov 14 19:09:37 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:09:37 user nova-compute[75205]:     </system>
Nov 14 19:09:37 user nova-compute[75205]:   </sysinfo>
Nov 14 19:09:37 user nova-compute[75205]:   <os>
Nov 14 19:09:37 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:09:37 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:09:37 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:09:37 user nova-compute[75205]:   </os>
Nov 14 19:09:37 user nova-compute[75205]:   <features>
Nov 14 19:09:37 user nova-compute[75205]:     <acpi/>
Nov 14 19:09:37 user nova-compute[75205]:     <apic/>
Nov 14 19:09:37 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:09:37 user nova-compute[75205]:   </features>
Nov 14 19:09:37 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:09:37 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:09:37 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:09:37 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:09:37 user nova-compute[75205]:   </clock>
Nov 14 19:09:37 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:09:37 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:09:37 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:09:37 user nova-compute[75205]:   </cpu>
Nov 14 19:09:37 user nova-compute[75205]:   <devices>
Nov 14 19:09:37 user nova-compute[75205]:     <disk type="file" device="cdrom">
Nov 14 19:09:37 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 19:09:37 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/7d9eda42-5048-4838-820b-45844f8e59b0/disk.config"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="hda" bus="ide"/>
Nov 14 19:09:37 user nova-compute[75205]:     </disk>
Nov 14 19:09:37 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:09:37 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:09:37 user nova-compute[75205]:       <source dev="/dev/sdc"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:       <serial>a062f787-b1d4-4d3a-81e8-1de96f792979</serial>
Nov 14 19:09:37 user nova-compute[75205]:     </disk>
Nov 14 19:09:37 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:09:37 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:09:37 user nova-compute[75205]:       <source dev="/dev/sdd"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:       <serial>e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb</serial>
Nov 14 19:09:37 user nova-compute[75205]:     </disk>
Nov 14 19:09:37 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:09:37 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:09:37 user nova-compute[75205]:       <source dev="/dev/sde"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="vdc" bus="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:       <serial>6c21ab44-d890-463a-bf92-4245f30259b6</serial>
Nov 14 19:09:37 user nova-compute[75205]:     </disk>
Nov 14 19:09:37 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:09:37 user nova-compute[75205]:       <mac address="fa:16:3e:04:45:34"/>
Nov 14 19:09:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="tap6ca76c67-3d"/>
Nov 14 19:09:37 user nova-compute[75205]:     </interface>
Nov 14 19:09:37 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:09:37 user nova-compute[75205]:       <mac address="fa:16:3e:a2:55:34"/>
Nov 14 19:09:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="tapf0a2b257-cb"/>
Nov 14 19:09:37 user nova-compute[75205]:     </interface>
Nov 14 19:09:37 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:09:37 user nova-compute[75205]:       <mac address="fa:16:3e:aa:a4:73"/>
Nov 14 19:09:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="tapb82bff6e-be"/>
Nov 14 19:09:37 user nova-compute[75205]:     </interface>
Nov 14 19:09:37 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:09:37 user nova-compute[75205]:       <mac address="fa:16:3e:69:03:a5"/>
Nov 14 19:09:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="tap409075c5-56"/>
Nov 14 19:09:37 user nova-compute[75205]:     </interface>
Nov 14 19:09:37 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:09:37 user nova-compute[75205]:       <mac address="fa:16:3e:ba:ac:b3"/>
Nov 14 19:09:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="tap4b2e49ca-5b"/>
Nov 14 19:09:37 user nova-compute[75205]:     </interface>
Nov 14 19:09:37 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:09:37 user nova-compute[75205]:       <mac address="fa:16:3e:d6:6e:31"/>
Nov 14 19:09:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="tapc3895efd-28"/>
Nov 14 19:09:37 user nova-compute[75205]:     </interface>
Nov 14 19:09:37 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:09:37 user nova-compute[75205]:       <mac address="fa:16:3e:d6:54:c6"/>
Nov 14 19:09:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:09:37 user nova-compute[75205]:       <target dev="tap4c9e16ea-3c"/>
Nov 14 19:09:37 user nova-compute[75205]:     </interface>
Nov 14 19:09:37 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:09:37 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/7d9eda42-5048-4838-820b-45844f8e59b0/console.log" append="off"/>
Nov 14 19:09:37 user nova-compute[75205]:     </serial>
Nov 14 19:09:37 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:09:37 user nova-compute[75205]:     <video>
Nov 14 19:09:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:37 user nova-compute[75205]:     </video>
Nov 14 19:09:37 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:09:37 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:09:37 user nova-compute[75205]:     </rng>
Nov 14 19:09:37 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:09:37 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:09:37 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:09:37 user nova-compute[75205]:     </memballoon>
Nov 14 19:09:37 user nova-compute[75205]:   </devices>
Nov 14 19:09:37 user nova-compute[75205]: </domain>
Nov 14 19:09:37 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:45:34,bridge_name='br-int',has_traffic_filtering=True,id=6ca76c67-3d07-45f3-b07f-5c997c4392d4,network=Network(23fcee45-779d-4b5f-9599-1a91c0f3f58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca76c67-3d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:45:34,bridge_name='br-int',has_traffic_filtering=True,id=6ca76c67-3d07-45f3-b07f-5c997c4392d4,network=Network(23fcee45-779d-4b5f-9599-1a91c0f3f58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca76c67-3d') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbcf318f-0aec-583a-8e4b-ac2e425af67e', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ca76c67-3d, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ca76c67-3d, col_values=(('qos', UUID('29201c3f-c0af-4a2f-92fb-e5bb5211aebf')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ca76c67-3d, col_values=(('external_ids', {'iface-id': '6ca76c67-3d07-45f3-b07f-5c997c4392d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:45:34', 'vm-uuid': '7d9eda42-5048-4838-820b-45844f8e59b0'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: INFO os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:45:34,bridge_name='br-int',has_traffic_filtering=True,id=6ca76c67-3d07-45f3-b07f-5c997c4392d4,network=Network(23fcee45-779d-4b5f-9599-1a91c0f3f58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca76c67-3d')
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:55:34,bridge_name='br-int',has_traffic_filtering=True,id=f0a2b257-cbd8-45df-8fa6-b25c8c22d129,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0a2b257-cb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:55:34,bridge_name='br-int',has_traffic_filtering=True,id=f0a2b257-cbd8-45df-8fa6-b25c8c22d129,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0a2b257-cb') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '176dce66-2887-5a6b-bc98-c7c67e8674b5', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0a2b257-cb, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0a2b257-cb, col_values=(('qos', UUID('aeb7f374-2754-415d-b1e6-51bf7e647056')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0a2b257-cb, col_values=(('external_ids', {'iface-id': 'f0a2b257-cbd8-45df-8fa6-b25c8c22d129', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:55:34', 'vm-uuid': '7d9eda42-5048-4838-820b-45844f8e59b0'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: INFO os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:55:34,bridge_name='br-int',has_traffic_filtering=True,id=f0a2b257-cbd8-45df-8fa6-b25c8c22d129,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0a2b257-cb')
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:a4:73,bridge_name='br-int',has_traffic_filtering=True,id=b82bff6e-beb2-4812-9927-0e5ba4fc1101,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb82bff6e-be') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:a4:73,bridge_name='br-int',has_traffic_filtering=True,id=b82bff6e-beb2-4812-9927-0e5ba4fc1101,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb82bff6e-be') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44c11227-2e43-5c2e-97eb-14c397ac0156', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb82bff6e-be, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb82bff6e-be, col_values=(('qos', UUID('395790db-5e2d-4684-892c-1f9e547b8b1d')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb82bff6e-be, col_values=(('external_ids', {'iface-id': 'b82bff6e-beb2-4812-9927-0e5ba4fc1101', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:a4:73', 'vm-uuid': '7d9eda42-5048-4838-820b-45844f8e59b0'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: INFO os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:a4:73,bridge_name='br-int',has_traffic_filtering=True,id=b82bff6e-beb2-4812-9927-0e5ba4fc1101,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb82bff6e-be')
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:a5,bridge_name='br-int',has_traffic_filtering=True,id=409075c5-56a9-4921-b141-1e30e8cebc9f,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409075c5-56') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:a5,bridge_name='br-int',has_traffic_filtering=True,id=409075c5-56a9-4921-b141-1e30e8cebc9f,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409075c5-56') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '539bd790-dbdf-5bc2-9e08-4aea4c11efd8', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap409075c5-56, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap409075c5-56, col_values=(('qos', UUID('5806d0b4-2be9-4e09-b3ae-0b668ebc5152')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap409075c5-56, col_values=(('external_ids', {'iface-id': '409075c5-56a9-4921-b141-1e30e8cebc9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:03:a5', 'vm-uuid': '7d9eda42-5048-4838-820b-45844f8e59b0'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: INFO os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:a5,bridge_name='br-int',has_traffic_filtering=True,id=409075c5-56a9-4921-b141-1e30e8cebc9f,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409075c5-56')
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ac:b3,bridge_name='br-int',has_traffic_filtering=True,id=4b2e49ca-5b36-4020-82b5-6e755b1795fd,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2e49ca-5b') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ac:b3,bridge_name='br-int',has_traffic_filtering=True,id=4b2e49ca-5b36-4020-82b5-6e755b1795fd,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2e49ca-5b') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e815dc47-0f08-59f8-853b-095992c8d7c7', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b2e49ca-5b, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b2e49ca-5b, col_values=(('qos', UUID('28925b43-960a-49fb-b894-5753909d34b2')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b2e49ca-5b, col_values=(('external_ids', {'iface-id': '4b2e49ca-5b36-4020-82b5-6e755b1795fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:ac:b3', 'vm-uuid': '7d9eda42-5048-4838-820b-45844f8e59b0'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: INFO os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ac:b3,bridge_name='br-int',has_traffic_filtering=True,id=4b2e49ca-5b36-4020-82b5-6e755b1795fd,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2e49ca-5b')
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:31,bridge_name='br-int',has_traffic_filtering=True,id=c3895efd-2875-45b4-a318-ac6b9d2149c2,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3895efd-28') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:31,bridge_name='br-int',has_traffic_filtering=True,id=c3895efd-2875-45b4-a318-ac6b9d2149c2,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3895efd-28') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6936f868-0c8f-5e58-bd66-99da42870a37', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3895efd-28, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3895efd-28, col_values=(('qos', UUID('259cddb1-0666-4396-bc1c-9cd108550de8')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3895efd-28, col_values=(('external_ids', {'iface-id': 'c3895efd-2875-45b4-a318-ac6b9d2149c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:6e:31', 'vm-uuid': '7d9eda42-5048-4838-820b-45844f8e59b0'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: INFO os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:31,bridge_name='br-int',has_traffic_filtering=True,id=c3895efd-2875-45b4-a318-ac6b9d2149c2,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3895efd-28')
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=4c9e16ea-3c98-4988-8101-527a7cd92765,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9e16ea-3c') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=4c9e16ea-3c98-4988-8101-527a7cd92765,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9e16ea-3c') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6d0e64d-858c-53f1-b4ae-dddb9662f1c4', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c9e16ea-3c, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c9e16ea-3c, col_values=(('qos', UUID('eab2e28f-645f-4d6b-92e4-d06414b367f6')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c9e16ea-3c, col_values=(('external_ids', {'iface-id': '4c9e16ea-3c98-4988-8101-527a7cd92765', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:54:c6', 'vm-uuid': '7d9eda42-5048-4838-820b-45844f8e59b0'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:38 user nova-compute[75205]: INFO os_vif [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=4c9e16ea-3c98-4988-8101-527a7cd92765,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9e16ea-3c')
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] No BDM found with device name hda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] No VIF found with MAC fa:16:3e:04:45:34, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:09:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] No VIF found with MAC fa:16:3e:ba:ac:b3, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:09:38 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Using config drive
Nov 14 19:09:38 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Creating config drive at /opt/stack/data/nova/instances/7d9eda42-5048-4838-820b-45844f8e59b0/disk.config
Nov 14 19:09:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d9eda42-5048-4838-820b-45844f8e59b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpurv7oj1v {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d9eda42-5048-4838-820b-45844f8e59b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpurv7oj1v" returned: 0 in 0.058s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-f7860ec4-c34d-430f-af1c-7a5c2afeffed req-0901253e-f303-4dce-ab79-8fbdaf7c806b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f7860ec4-c34d-430f-af1c-7a5c2afeffed req-0901253e-f303-4dce-ab79-8fbdaf7c806b service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f7860ec4-c34d-430f-af1c-7a5c2afeffed req-0901253e-f303-4dce-ab79-8fbdaf7c806b service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f7860ec4-c34d-430f-af1c-7a5c2afeffed req-0901253e-f303-4dce-ab79-8fbdaf7c806b service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-f7860ec4-c34d-430f-af1c-7a5c2afeffed req-0901253e-f303-4dce-ab79-8fbdaf7c806b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:41 user nova-compute[75205]: WARNING nova.compute.manager [req-f7860ec4-c34d-430f-af1c-7a5c2afeffed req-0901253e-f303-4dce-ab79-8fbdaf7c806b service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 for instance with vm_state building and task_state spawning.
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-2be4ed0e-727c-4d91-93b9-87acefd0f492 req-67990019-45f5-46c9-94ad-005167158ffd service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2be4ed0e-727c-4d91-93b9-87acefd0f492 req-67990019-45f5-46c9-94ad-005167158ffd service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2be4ed0e-727c-4d91-93b9-87acefd0f492 req-67990019-45f5-46c9-94ad-005167158ffd service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2be4ed0e-727c-4d91-93b9-87acefd0f492 req-67990019-45f5-46c9-94ad-005167158ffd service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-2be4ed0e-727c-4d91-93b9-87acefd0f492 req-67990019-45f5-46c9-94ad-005167158ffd service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:43 user nova-compute[75205]: WARNING nova.compute.manager [req-2be4ed0e-727c-4d91-93b9-87acefd0f492 req-67990019-45f5-46c9-94ad-005167158ffd service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-4c9e16ea-3c98-4988-8101-527a7cd92765 for instance with vm_state building and task_state spawning.
Nov 14 19:09:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:43 user nova-compute[75205]: WARNING nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 for instance with vm_state building and task_state spawning.
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:43 user nova-compute[75205]: WARNING nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-409075c5-56a9-4921-b141-1e30e8cebc9f for instance with vm_state building and task_state spawning.
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:43 user nova-compute[75205]: WARNING nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-409075c5-56a9-4921-b141-1e30e8cebc9f for instance with vm_state building and task_state spawning.
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:43 user nova-compute[75205]: WARNING nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 for instance with vm_state building and task_state spawning.
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:43 user nova-compute[75205]: WARNING nova.compute.manager [req-38b85e57-bb31-4156-b459-affcbc175494 req-1192d421-bb08-48f3-9927-a983f2c7ffc0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 for instance with vm_state building and task_state spawning.
Nov 14 19:09:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:09:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:09:44 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance spawned successfully.
Nov 14 19:09:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:09:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:44 user nova-compute[75205]: INFO nova.compute.manager [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Took 11.32 seconds to spawn the instance on the hypervisor.
Nov 14 19:09:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:09:45 user nova-compute[75205]: INFO nova.compute.manager [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Took 32.68 seconds to build instance.
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-00e46fd4-d110-4e04-946c-5a1c9aaf5074 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "7d9eda42-5048-4838-820b-45844f8e59b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.835s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-aefbde4a-df2d-475d-bfd5-292ee35c73b3 req-e62a92ed-fa9c-411d-b149-beed85197cfc service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-aefbde4a-df2d-475d-bfd5-292ee35c73b3 req-e62a92ed-fa9c-411d-b149-beed85197cfc service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-aefbde4a-df2d-475d-bfd5-292ee35c73b3 req-e62a92ed-fa9c-411d-b149-beed85197cfc service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-aefbde4a-df2d-475d-bfd5-292ee35c73b3 req-e62a92ed-fa9c-411d-b149-beed85197cfc service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-aefbde4a-df2d-475d-bfd5-292ee35c73b3 req-e62a92ed-fa9c-411d-b149-beed85197cfc service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:45 user nova-compute[75205]: WARNING nova.compute.manager [req-aefbde4a-df2d-475d-bfd5-292ee35c73b3 req-e62a92ed-fa9c-411d-b149-beed85197cfc service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-4c9e16ea-3c98-4988-8101-527a7cd92765 for instance with vm_state active and task_state None.
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-e903095e-8015-4cad-94d5-73515768c03b req-9455753c-78ed-4f85-a3f8-7585de9c2508 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e903095e-8015-4cad-94d5-73515768c03b req-9455753c-78ed-4f85-a3f8-7585de9c2508 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e903095e-8015-4cad-94d5-73515768c03b req-9455753c-78ed-4f85-a3f8-7585de9c2508 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e903095e-8015-4cad-94d5-73515768c03b req-9455753c-78ed-4f85-a3f8-7585de9c2508 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-e903095e-8015-4cad-94d5-73515768c03b req-9455753c-78ed-4f85-a3f8-7585de9c2508 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:45 user nova-compute[75205]: WARNING nova.compute.manager [req-e903095e-8015-4cad-94d5-73515768c03b req-9455753c-78ed-4f85-a3f8-7585de9c2508 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 for instance with vm_state active and task_state None.
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:09:45 user nova-compute[75205]: INFO nova.compute.claims [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Claim successful on node user
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Refreshing inventories for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Updating ProviderTree inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Refreshing aggregate associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, aggregates: None {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Refreshing trait associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, traits: HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 19:09:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG nova.network.neutron [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:09:46 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:09:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:09:46 user nova-compute[75205]: INFO nova.virt.block_device [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Booting with volume bfabcc69-245e-4604-b0f7-19a66c796651 at /dev/vda
Nov 14 19:09:46 user nova-compute[75205]: DEBUG nova.policy [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07cd34c968a9444a95fd601767385cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b1f81e3e4a4ae3a9b7554997d170c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG os_brick.utils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c197691-0f00-4ffc-b3c7-2e3f9eef6735]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[905c5add-af32-47ea-9138-db41da47f00a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8c5fc4-4f6c-4470-8e11-48e8804683d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e682f025-cf96-4691-b036-1b6d1677fba2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:09:46 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:09:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c873db7-5645-4eca-8cc9-b32931e4d851]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG os_brick.utils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:09:46 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating existing volume attachment record: c26ce7b2-60bd-40de-9dc9-b7d724a7fd4b {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.network.neutron [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Successfully created port: d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:47 user nova-compute[75205]: WARNING nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 for instance with vm_state active and task_state None.
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:47 user nova-compute[75205]: WARNING nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 for instance with vm_state active and task_state None.
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:47 user nova-compute[75205]: WARNING nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 for instance with vm_state active and task_state None.
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:47 user nova-compute[75205]: WARNING nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd for instance with vm_state active and task_state None.
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:47 user nova-compute[75205]: WARNING nova.compute.manager [req-6676ea6a-2fd3-4505-ac1a-c603503526d5 req-a2261c01-81bc-4ef7-a0ee-de93a3f10813 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd for instance with vm_state active and task_state None.
Nov 14 19:09:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Successfully updated port: d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:09:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquired lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:09:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:09:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating instance_info_cache with network_info: [{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Releasing lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Instance network_info: |[{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:09:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-2daf6d02-e793-44e0-a6c1-107afd1cd6db req-3a05328c-caa3-4489-9635-8d65aa86324e service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-changed-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-2daf6d02-e793-44e0-a6c1-107afd1cd6db req-3a05328c-caa3-4489-9635-8d65aa86324e service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Refreshing instance network info cache due to event network-changed-d78d73b9-cc60-4324-b5e4-2dede8700c73. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:09:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2daf6d02-e793-44e0-a6c1-107afd1cd6db req-3a05328c-caa3-4489-9635-8d65aa86324e service nova] Acquiring lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2daf6d02-e793-44e0-a6c1-107afd1cd6db req-3a05328c-caa3-4489-9635-8d65aa86324e service nova] Acquired lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:49 user nova-compute[75205]: DEBUG nova.network.neutron [req-2daf6d02-e793-44e0-a6c1-107afd1cd6db req-3a05328c-caa3-4489-9635-8d65aa86324e service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Refreshing network info cache for port d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:09:50 user nova-compute[75205]: DEBUG nova.network.neutron [req-2daf6d02-e793-44e0-a6c1-107afd1cd6db req-3a05328c-caa3-4489-9635-8d65aa86324e service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updated VIF entry in instance network info cache for port d78d73b9-cc60-4324-b5e4-2dede8700c73. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:09:50 user nova-compute[75205]: DEBUG nova.network.neutron [req-2daf6d02-e793-44e0-a6c1-107afd1cd6db req-3a05328c-caa3-4489-9635-8d65aa86324e service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating instance_info_cache with network_info: [{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2daf6d02-e793-44e0-a6c1-107afd1cd6db req-3a05328c-caa3-4489-9635-8d65aa86324e service nova] Releasing lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:09:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Creating image(s)
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Ensure instance console log exists: /opt/stack/data/nova/instances/a3f91cd5-9ad2-49a0-9b53-4df71c63ff29/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Start _get_guest_xml network_info=[{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbIWepfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3f91cd5-9ad2-49a0-9b53-4df71c63ff29', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfabcc69-245e-4604-b0f7-19a66c796651', 'serial': 'bfabcc69-245e-4604-b0f7-19a66c796651'}, 'attachment_id': 'c26ce7b2-60bd-40de-9dc9-b7d724a7fd4b', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:09:52 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:09:52 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbIWepfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:09:52 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:09:52 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:09:52 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d95fe6-c1f7-4631-b70d-c6085eaf2fca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:09:52 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[67af5d98-b324-4fb5-bd83-cd5b5fb094ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651] added
Nov 14 19:09:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[579fb705-c505-4665-8d8b-fc257e60ebb6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[edff2f6b-2f1c-4ab3-bae4-0aa0f5823b57]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbIWepfx {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbIWepfx" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[af137efa-a091-4f0b-bbd2-21df1226871c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbIWepfx'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0827dee1-7f62-4542-b64e-ae9194309e33]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae21345-d3e9-4f19-bdbd-95ac1e25d575]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bb598c-2d1f-45ab-b11b-bdb8dd8df559]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260]
Nov 14 19:09:52 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260] successful.
Nov 14 19:09:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d78bb4-8a95-4f9a-80bd-b615df39909b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aae158-09c2-458e-aeaf-6fd1d4f64400]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:09:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[465177c0-909f-4c1f-bd2c-0377142655d2]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:09:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbIWepfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:09:53 user nova-compute[75205]: INFO nova.compute.claims [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Claim successful on node user
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26634663734653131', 'path': '/dev/sdf'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634663734653131', 'path': '/dev/sdf'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-12776011',display_name='tempest-TestShelveInstance-server-12776011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-12776011',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyH+B2L9vDS52XGIOFtQq8GpoMcT6XKkpN4qVH8KFroHuiUxYrcjFcY9smZubExjgKxjYqZYOi2P2yxFniSvEDm0BToHMxKwXbhhxdZEWS5bAjtVcp6fhFwddzwHUoFew==',key_name='tempest-TestShelveInstance-1819955855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2b1f81e3e4a4ae3a9b7554997d170c1',ramdisk_id='',reservation_id='r-rm2y2t00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1961803319',owner_user_name='tempest-TestShelveInstance-1961803319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:46Z,user_data=None,user_id='07cd34c968a9444a95fd601767385cfe',uuid=a3f91cd5-9ad2-49a0-9b53-4df71c63ff29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converting VIF {"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lazy-loading 'pci_devices' on Instance uuid a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:09:53 user nova-compute[75205]:   <uuid>a3f91cd5-9ad2-49a0-9b53-4df71c63ff29</uuid>
Nov 14 19:09:53 user nova-compute[75205]:   <name>instance-0000000a</name>
Nov 14 19:09:53 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:09:53 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:09:53 user nova-compute[75205]:   <metadata>
Nov 14 19:09:53 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:09:53 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:09:53 user nova-compute[75205]:       <nova:name>tempest-TestShelveInstance-server-12776011</nova:name>
Nov 14 19:09:53 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:09:52</nova:creationTime>
Nov 14 19:09:53 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:09:53 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:09:53 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:09:53 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:09:53 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:09:53 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:09:53 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:09:53 user nova-compute[75205]:       <nova:owner>
Nov 14 19:09:53 user nova-compute[75205]:         <nova:user uuid="07cd34c968a9444a95fd601767385cfe">tempest-TestShelveInstance-1961803319-project-member</nova:user>
Nov 14 19:09:53 user nova-compute[75205]:         <nova:project uuid="d2b1f81e3e4a4ae3a9b7554997d170c1">tempest-TestShelveInstance-1961803319</nova:project>
Nov 14 19:09:53 user nova-compute[75205]:       </nova:owner>
Nov 14 19:09:53 user nova-compute[75205]:       <nova:ports>
Nov 14 19:09:53 user nova-compute[75205]:         <nova:port uuid="d78d73b9-cc60-4324-b5e4-2dede8700c73">
Nov 14 19:09:53 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:09:53 user nova-compute[75205]:         </nova:port>
Nov 14 19:09:53 user nova-compute[75205]:       </nova:ports>
Nov 14 19:09:53 user nova-compute[75205]:     </nova:instance>
Nov 14 19:09:53 user nova-compute[75205]:   </metadata>
Nov 14 19:09:53 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:09:53 user nova-compute[75205]:     <system>
Nov 14 19:09:53 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:09:53 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:09:53 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:09:53 user nova-compute[75205]:       <entry name="serial">a3f91cd5-9ad2-49a0-9b53-4df71c63ff29</entry>
Nov 14 19:09:53 user nova-compute[75205]:       <entry name="uuid">a3f91cd5-9ad2-49a0-9b53-4df71c63ff29</entry>
Nov 14 19:09:53 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:09:53 user nova-compute[75205]:     </system>
Nov 14 19:09:53 user nova-compute[75205]:   </sysinfo>
Nov 14 19:09:53 user nova-compute[75205]:   <os>
Nov 14 19:09:53 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:09:53 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:09:53 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:09:53 user nova-compute[75205]:   </os>
Nov 14 19:09:53 user nova-compute[75205]:   <features>
Nov 14 19:09:53 user nova-compute[75205]:     <acpi/>
Nov 14 19:09:53 user nova-compute[75205]:     <apic/>
Nov 14 19:09:53 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:09:53 user nova-compute[75205]:   </features>
Nov 14 19:09:53 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:09:53 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:09:53 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:09:53 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:09:53 user nova-compute[75205]:   </clock>
Nov 14 19:09:53 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:09:53 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:09:53 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:09:53 user nova-compute[75205]:   </cpu>
Nov 14 19:09:53 user nova-compute[75205]:   <devices>
Nov 14 19:09:53 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:09:53 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:09:53 user nova-compute[75205]:       <source dev="/dev/sdf"/>
Nov 14 19:09:53 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:09:53 user nova-compute[75205]:       <serial>bfabcc69-245e-4604-b0f7-19a66c796651</serial>
Nov 14 19:09:53 user nova-compute[75205]:     </disk>
Nov 14 19:09:53 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:09:53 user nova-compute[75205]:       <mac address="fa:16:3e:9c:b5:45"/>
Nov 14 19:09:53 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:53 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:09:53 user nova-compute[75205]:       <target dev="tapd78d73b9-cc"/>
Nov 14 19:09:53 user nova-compute[75205]:     </interface>
Nov 14 19:09:53 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:09:53 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/a3f91cd5-9ad2-49a0-9b53-4df71c63ff29/console.log" append="off"/>
Nov 14 19:09:53 user nova-compute[75205]:     </serial>
Nov 14 19:09:53 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:09:53 user nova-compute[75205]:     <video>
Nov 14 19:09:53 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:53 user nova-compute[75205]:     </video>
Nov 14 19:09:53 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:09:53 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:09:53 user nova-compute[75205]:     </rng>
Nov 14 19:09:53 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:09:53 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:09:53 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:09:53 user nova-compute[75205]:     </memballoon>
Nov 14 19:09:53 user nova-compute[75205]:   </devices>
Nov 14 19:09:53 user nova-compute[75205]: </domain>
Nov 14 19:09:53 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-12776011',display_name='tempest-TestShelveInstance-server-12776011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-12776011',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyH+B2L9vDS52XGIOFtQq8GpoMcT6XKkpN4qVH8KFroHuiUxYrcjFcY9smZubExjgKxjYqZYOi2P2yxFniSvEDm0BToHMxKwXbhhxdZEWS5bAjtVcp6fhFwddzwHUoFew==',key_name='tempest-TestShelveInstance-1819955855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2b1f81e3e4a4ae3a9b7554997d170c1',ramdisk_id='',reservation_id='r-rm2y2t00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1961803319',owner_user_name='tempest-TestShelveInstance-1961803319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:46Z,user_data=None,user_id='07cd34c968a9444a95fd601767385cfe',uuid=a3f91cd5-9ad2-49a0-9b53-4df71c63ff29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converting VIF {"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG os_vif [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '881fdb6b-870c-587f-bfac-97041ea7bf7f', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd78d73b9-cc, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd78d73b9-cc, col_values=(('qos', UUID('a1a71d36-df45-4b75-a83a-3b511c3b7172')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd78d73b9-cc, col_values=(('external_ids', {'iface-id': 'd78d73b9-cc60-4324-b5e4-2dede8700c73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:b5:45', 'vm-uuid': 'a3f91cd5-9ad2-49a0-9b53-4df71c63ff29'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:53 user nova-compute[75205]: INFO os_vif [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc')
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:09:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] No VIF found with MAC fa:16:3e:9c:b5:45, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:09:54 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:09:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG nova.policy [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00affbfeb9df44da953130a4ca8f3969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be48693253e4be8989e5ddb7ddda587', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:09:54 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Creating image(s)
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "/opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "/opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "/opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk 1073741824" returned: 0 in 0.078s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Successfully created port: 084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Cannot resize image /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Ensure instance console log exists: /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Successfully updated port: 084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "refresh_cache-26a6a013-500d-4502-a9f1-cffef3c4ba27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquired lock "refresh_cache-26a6a013-500d-4502-a9f1-cffef3c4ba27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-5e8cf863-eab9-49e7-8e25-409c966834d8 req-4797723b-63dc-44fe-a2e3-8dcc80ef185a service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5e8cf863-eab9-49e7-8e25-409c966834d8 req-4797723b-63dc-44fe-a2e3-8dcc80ef185a service nova] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5e8cf863-eab9-49e7-8e25-409c966834d8 req-4797723b-63dc-44fe-a2e3-8dcc80ef185a service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5e8cf863-eab9-49e7-8e25-409c966834d8 req-4797723b-63dc-44fe-a2e3-8dcc80ef185a service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-5e8cf863-eab9-49e7-8e25-409c966834d8 req-4797723b-63dc-44fe-a2e3-8dcc80ef185a service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] No waiting events found dispatching network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:55 user nova-compute[75205]: WARNING nova.compute.manager [req-5e8cf863-eab9-49e7-8e25-409c966834d8 req-4797723b-63dc-44fe-a2e3-8dcc80ef185a service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received unexpected event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 for instance with vm_state building and task_state spawning.
Nov 14 19:09:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.network.neutron [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Updating instance_info_cache with network_info: [{"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Releasing lock "refresh_cache-26a6a013-500d-4502-a9f1-cffef3c4ba27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.compute.manager [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Instance network_info: |[{"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Start _get_guest_xml network_info=[{"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:09:56 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:09:56 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-221337393',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-221337393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2213373',id=11,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9UZsuGYmLqPDuQ/bD6c2As4gMKwpFHCTosimF+Xvt4HdB1mNyK+JVEVQzbVKvXifcTuJHUvvp5Dmx5NOGouBlizROs7gBkQg3Ww7o4M1Zr4igf4DvqypsYh4V3B7k6DA==',key_name='tempest-keypair-702390106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6be48693253e4be8989e5ddb7ddda587',ramdisk_id='',reservation_id='r-74d9x4gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-412054473',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00affbfeb9df44da953130a4ca8f3969',uuid=26a6a013-500d-4502-a9f1-cffef3c4ba27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Converting VIF {"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=084929fe-e98b-437e-8bbd-4b3c0ec7d97a,network=Network(f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084929fe-e9') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.objects.instance [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lazy-loading 'pci_devices' on Instance uuid 26a6a013-500d-4502-a9f1-cffef3c4ba27 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:09:56 user nova-compute[75205]:   <uuid>26a6a013-500d-4502-a9f1-cffef3c4ba27</uuid>
Nov 14 19:09:56 user nova-compute[75205]:   <name>instance-0000000b</name>
Nov 14 19:09:56 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:09:56 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:09:56 user nova-compute[75205]:   <metadata>
Nov 14 19:09:56 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:09:56 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:09:56 user nova-compute[75205]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-221337393</nova:name>
Nov 14 19:09:56 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:09:56</nova:creationTime>
Nov 14 19:09:56 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:09:56 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:09:56 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:09:56 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:09:56 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:09:56 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:09:56 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:09:56 user nova-compute[75205]:       <nova:owner>
Nov 14 19:09:56 user nova-compute[75205]:         <nova:user uuid="00affbfeb9df44da953130a4ca8f3969">tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member</nova:user>
Nov 14 19:09:56 user nova-compute[75205]:         <nova:project uuid="6be48693253e4be8989e5ddb7ddda587">tempest-TestServerVolumeAttachScenarioOldVersion-412054473</nova:project>
Nov 14 19:09:56 user nova-compute[75205]:       </nova:owner>
Nov 14 19:09:56 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:09:56 user nova-compute[75205]:       <nova:ports>
Nov 14 19:09:56 user nova-compute[75205]:         <nova:port uuid="084929fe-e98b-437e-8bbd-4b3c0ec7d97a">
Nov 14 19:09:56 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 19:09:56 user nova-compute[75205]:         </nova:port>
Nov 14 19:09:56 user nova-compute[75205]:       </nova:ports>
Nov 14 19:09:56 user nova-compute[75205]:     </nova:instance>
Nov 14 19:09:56 user nova-compute[75205]:   </metadata>
Nov 14 19:09:56 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:09:56 user nova-compute[75205]:     <system>
Nov 14 19:09:56 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:09:56 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:09:56 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:09:56 user nova-compute[75205]:       <entry name="serial">26a6a013-500d-4502-a9f1-cffef3c4ba27</entry>
Nov 14 19:09:56 user nova-compute[75205]:       <entry name="uuid">26a6a013-500d-4502-a9f1-cffef3c4ba27</entry>
Nov 14 19:09:56 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:09:56 user nova-compute[75205]:     </system>
Nov 14 19:09:56 user nova-compute[75205]:   </sysinfo>
Nov 14 19:09:56 user nova-compute[75205]:   <os>
Nov 14 19:09:56 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:09:56 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:09:56 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:09:56 user nova-compute[75205]:   </os>
Nov 14 19:09:56 user nova-compute[75205]:   <features>
Nov 14 19:09:56 user nova-compute[75205]:     <acpi/>
Nov 14 19:09:56 user nova-compute[75205]:     <apic/>
Nov 14 19:09:56 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:09:56 user nova-compute[75205]:   </features>
Nov 14 19:09:56 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:09:56 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:09:56 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:09:56 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:09:56 user nova-compute[75205]:   </clock>
Nov 14 19:09:56 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:09:56 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:09:56 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:09:56 user nova-compute[75205]:   </cpu>
Nov 14 19:09:56 user nova-compute[75205]:   <devices>
Nov 14 19:09:56 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:09:56 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:09:56 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk"/>
Nov 14 19:09:56 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:09:56 user nova-compute[75205]:     </disk>
Nov 14 19:09:56 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:09:56 user nova-compute[75205]:       <mac address="fa:16:3e:e3:cb:d7"/>
Nov 14 19:09:56 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:56 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:09:56 user nova-compute[75205]:       <target dev="tap084929fe-e9"/>
Nov 14 19:09:56 user nova-compute[75205]:     </interface>
Nov 14 19:09:56 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:09:56 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/console.log" append="off"/>
Nov 14 19:09:56 user nova-compute[75205]:     </serial>
Nov 14 19:09:56 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:09:56 user nova-compute[75205]:     <video>
Nov 14 19:09:56 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:09:56 user nova-compute[75205]:     </video>
Nov 14 19:09:56 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:09:56 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:09:56 user nova-compute[75205]:     </rng>
Nov 14 19:09:56 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:09:56 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:09:56 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:09:56 user nova-compute[75205]:     </memballoon>
Nov 14 19:09:56 user nova-compute[75205]:   </devices>
Nov 14 19:09:56 user nova-compute[75205]: </domain>
Nov 14 19:09:56 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-221337393',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-221337393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2213373',id=11,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9UZsuGYmLqPDuQ/bD6c2As4gMKwpFHCTosimF+Xvt4HdB1mNyK+JVEVQzbVKvXifcTuJHUvvp5Dmx5NOGouBlizROs7gBkQg3Ww7o4M1Zr4igf4DvqypsYh4V3B7k6DA==',key_name='tempest-keypair-702390106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6be48693253e4be8989e5ddb7ddda587',ramdisk_id='',reservation_id='r-74d9x4gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-412054473',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00affbfeb9df44da953130a4ca8f3969',uuid=26a6a013-500d-4502-a9f1-cffef3c4ba27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Converting VIF {"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=084929fe-e98b-437e-8bbd-4b3c0ec7d97a,network=Network(f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084929fe-e9') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG os_vif [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=084929fe-e98b-437e-8bbd-4b3c0ec7d97a,network=Network(f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084929fe-e9') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0ff6356-f851-5ae8-a38b-d6a25200545c', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap084929fe-e9, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap084929fe-e9, col_values=(('qos', UUID('7b0ee26b-cdaf-4005-9db4-deb5b19fc3d6')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap084929fe-e9, col_values=(('external_ids', {'iface-id': '084929fe-e98b-437e-8bbd-4b3c0ec7d97a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:cb:d7', 'vm-uuid': '26a6a013-500d-4502-a9f1-cffef3c4ba27'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:56 user nova-compute[75205]: INFO os_vif [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=084929fe-e98b-437e-8bbd-4b3c0ec7d97a,network=Network(f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084929fe-e9')
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:09:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] No VIF found with MAC fa:16:3e:e3:cb:d7, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:09:57 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Instance spawned successfully.
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received event network-changed-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Refreshing instance network info cache due to event network-changed-084929fe-e98b-437e-8bbd-4b3c0ec7d97a. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] Acquiring lock "refresh_cache-26a6a013-500d-4502-a9f1-cffef3c4ba27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] Acquired lock "refresh_cache-26a6a013-500d-4502-a9f1-cffef3c4ba27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.network.neutron [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Refreshing network info cache for port 084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:09:57 user nova-compute[75205]: INFO nova.compute.manager [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 14 19:09:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:09:57 user nova-compute[75205]: INFO nova.compute.manager [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Took 12.22 seconds to build instance.
Nov 14 19:09:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-045899da-ed62-46d9-a66d-495f6bf34841 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.343s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Updated VIF entry in instance network info cache for port 084929fe-e98b-437e-8bbd-4b3c0ec7d97a. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Updating instance_info_cache with network_info: [{"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] Releasing lock "refresh_cache-26a6a013-500d-4502-a9f1-cffef3c4ba27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] No waiting events found dispatching network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:58 user nova-compute[75205]: WARNING nova.compute.manager [req-ebedf6af-d901-4ea6-b0dd-2313c068ddc9 req-eccc51a4-5f33-4a88-a9f8-b4fd5240688c service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received unexpected event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 for instance with vm_state building and task_state spawning.
Nov 14 19:09:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:09:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received event network-vif-plugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] Acquiring lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] No waiting events found dispatching network-vif-plugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:59 user nova-compute[75205]: WARNING nova.compute.manager [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received unexpected event network-vif-plugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a for instance with vm_state building and task_state spawning.
Nov 14 19:09:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received event network-vif-plugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:09:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] Acquiring lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:09:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:09:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:09:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] No waiting events found dispatching network-vif-plugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:09:59 user nova-compute[75205]: WARNING nova.compute.manager [req-ece38ff4-d87b-4a7c-9643-b6e6da6abd05 req-fab0cd1a-6ce3-4ebe-a295-50f9c8858030 service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received unexpected event network-vif-plugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a for instance with vm_state building and task_state spawning.
Nov 14 19:10:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:10:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:10:00 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Instance spawned successfully.
Nov 14 19:10:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:10:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:00 user nova-compute[75205]: INFO nova.compute.manager [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 14 19:10:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:10:00 user nova-compute[75205]: INFO nova.compute.manager [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Took 7.26 seconds to build instance.
Nov 14 19:10:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-547fe3d8-08f8-4ab1-bf54-b4d0cfb41fb3 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.369s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "f185f08b-ea86-40f4-af2b-95badfddca27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "f185f08b-ea86-40f4-af2b-95badfddca27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lazy-loading 'flavor' on Instance uuid f185f08b-ea86-40f4-af2b-95badfddca27 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "f185f08b-ea86-40f4-af2b-95badfddca27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "f185f08b-ea86-40f4-af2b-95badfddca27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "f185f08b-ea86-40f4-af2b-95badfddca27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:10 user nova-compute[75205]: INFO nova.compute.manager [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Attaching volume 3938b513-43d8-4c6a-8725-b903cc427e83 to /dev/vdb
Nov 14 19:10:10 user nova-compute[75205]: DEBUG os_brick.utils [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[29309a13-3f54-4160-9557-39526ea55269]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ede3cc-e5e6-4795-bed0-a00fe4feeadf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93a0553-6e91-440e-bcff-cd00b544607b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5891f4ac-c850-4759-b1b1-842929472f3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:10 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:10:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a402ba5-ada9-4b55-82d8-9cb9bdba3bdc]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG os_brick.utils [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Updating existing volume attachment record: db77b7cb-b2b2-4456-b091-ec5a3c6bd740 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:10:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:10:12 user nova-compute[75205]: INFO nova.compute.manager [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] instance snapshotting
Nov 14 19:10:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Beginning live snapshot process
Nov 14 19:10:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json -f qcow2 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json -f qcow2" returned: 0 in 0.320s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json -f qcow2 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.236s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqyq6qi0j/9be5a8c3ca47436d90c6824f259b1425.delta 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqyq6qi0j/9be5a8c3ca47436d90c6824f259b1425.delta 1073741824" returned: 0 in 0.062s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:13 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 19:10:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75205) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 19:10:13 user nova-compute[75205]: INFO nova.virt.libvirt.host [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] UEFI support detected
Nov 14 19:10:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:10:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:10:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 19:10:14 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:10:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqyq6qi0j/9be5a8c3ca47436d90c6824f259b1425.delta /opt/stack/data/nova/instances/snapshots/tmpqyq6qi0j/9be5a8c3ca47436d90c6824f259b1425 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqyq6qi0j/9be5a8c3ca47436d90c6824f259b1425.delta /opt/stack/data/nova/instances/snapshots/tmpqyq6qi0j/9be5a8c3ca47436d90c6824f259b1425" returned: 0 in 0.295s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Snapshot extracted, beginning image upload
Nov 14 19:10:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDZViIRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:15 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:15 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:15 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3686e7-1667-45cf-87cb-7175e8b8bee3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:10:15 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7906a62-b0ce-46f9-99dc-38c9795b2d86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83] added
Nov 14 19:10:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b05f54-32fa-4afb-9a7e-1b952c180a25]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cc9524-10de-4d4a-a50f-13a4f8fb3ac0]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDZViIRq {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDZViIRq" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d50c033-1a09-4de7-a92c-28dd64a3d3dd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDZViIRq'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc23b897-dde6-4c62-a9ff-f7876721fc0d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e57699-d6c2-440c-a2ea-3c68027552fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8f77a9-f73c-421a-861f-1e9fcf534459]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83, portal: 172.16.0.220,3260]
Nov 14 19:10:15 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83, portal: 172.16.0.220,3260] successful.
Nov 14 19:10:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[413d06c1-e415-4b27-8c8f-bf24dd7e8bc6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e067d90-9367-4cca-9e0c-77518d8bb3f6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 (non-flash)
Nov 14 19:10:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f39e400-f098-49ac-ab19-ad81dcf0fce3]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDZViIRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:10:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26633316535653133', 'path': '/dev/sdg'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633316535653133', 'path': '/dev/sdg'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:10:16 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lazy-loading 'flavor' on Instance uuid f185f08b-ea86-40f4-af2b-95badfddca27 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:10:16 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:16 user nova-compute[75205]:   <source dev="/dev/sdg"/>
Nov 14 19:10:16 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:16 user nova-compute[75205]:   <serial>3938b513-43d8-4c6a-8725-b903cc427e83</serial>
Nov 14 19:10:16 user nova-compute[75205]: </disk>
Nov 14 19:10:16 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-8b51c9d3-7df9-472d-a018-6cc751ff6053 req-bcefa441-a2a8-4dbd-8b1c-22ca7a22b356 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-changed-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-8b51c9d3-7df9-472d-a018-6cc751ff6053 req-bcefa441-a2a8-4dbd-8b1c-22ca7a22b356 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Refreshing instance network info cache due to event network-changed-531d9209-139e-4463-9116-04f04ddca88e. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8b51c9d3-7df9-472d-a018-6cc751ff6053 req-bcefa441-a2a8-4dbd-8b1c-22ca7a22b356 service nova] Acquiring lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8b51c9d3-7df9-472d-a018-6cc751ff6053 req-bcefa441-a2a8-4dbd-8b1c-22ca7a22b356 service nova] Acquired lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG nova.network.neutron [req-8b51c9d3-7df9-472d-a018-6cc751ff6053 req-bcefa441-a2a8-4dbd-8b1c-22ca7a22b356 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Refreshing network info cache for port 531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] No VIF found with MAC fa:16:3e:b4:63:ad, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c216ae3-072e-4d82-9965-df7bcf82a99e tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "f185f08b-ea86-40f4-af2b-95badfddca27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.905s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG nova.network.neutron [req-8b51c9d3-7df9-472d-a018-6cc751ff6053 req-bcefa441-a2a8-4dbd-8b1c-22ca7a22b356 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updated VIF entry in instance network info cache for port 531d9209-139e-4463-9116-04f04ddca88e. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG nova.network.neutron [req-8b51c9d3-7df9-472d-a018-6cc751ff6053 req-bcefa441-a2a8-4dbd-8b1c-22ca7a22b356 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updating instance_info_cache with network_info: [{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8b51c9d3-7df9-472d-a018-6cc751ff6053 req-bcefa441-a2a8-4dbd-8b1c-22ca7a22b356 service nova] Releasing lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:17 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Snapshot image upload complete
Nov 14 19:10:17 user nova-compute[75205]: INFO nova.compute.manager [None req-de3bfb25-9ffd-49cf-b5ae-238d541897db tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Took 5.64 seconds to snapshot the instance on the hypervisor.
Nov 14 19:10:18 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:10:18 user nova-compute[75205]: INFO nova.compute.manager [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] instance snapshotting
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "f185f08b-ea86-40f4-af2b-95badfddca27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "f185f08b-ea86-40f4-af2b-95badfddca27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:18 user nova-compute[75205]: INFO nova.compute.manager [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Terminating instance
Nov 14 19:10:18 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6e3657fa-d795-4732-852a-158c68452387] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-c24d2d0b-ec33-4592-9fcb-1522ec77b6cf req-6c895204-6b3a-4469-9bb8-c4101b6807a2 service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Received event network-vif-unplugged-48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c24d2d0b-ec33-4592-9fcb-1522ec77b6cf req-6c895204-6b3a-4469-9bb8-c4101b6807a2 service nova] Acquiring lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c24d2d0b-ec33-4592-9fcb-1522ec77b6cf req-6c895204-6b3a-4469-9bb8-c4101b6807a2 service nova] Lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c24d2d0b-ec33-4592-9fcb-1522ec77b6cf req-6c895204-6b3a-4469-9bb8-c4101b6807a2 service nova] Lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-c24d2d0b-ec33-4592-9fcb-1522ec77b6cf req-6c895204-6b3a-4469-9bb8-c4101b6807a2 service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] No waiting events found dispatching network-vif-unplugged-48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:10:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-c24d2d0b-ec33-4592-9fcb-1522ec77b6cf req-6c895204-6b3a-4469-9bb8-c4101b6807a2 service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Received event network-vif-unplugged-48790b5c-36b5-4f62-917c-7d6895779497 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:10:18 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Beginning live snapshot process
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json -f qcow2 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updating instance_info_cache with network_info: [{"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json -f qcow2 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Instance destroyed successfully.
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lazy-loading 'resources' on Instance uuid f185f08b-ea86-40f4-af2b-95badfddca27 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1320716125',display_name='tempest-DeleteServersTestJSON-server-1320716125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1320716125',id=1,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae966ad209f94612b452b66061acef49',ramdisk_id='',reservation_id='r-yth6p5ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2128794415',owner_user_name='tempest-DeleteServersTestJSON-2128794415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:08:38Z,user_data=None,user_id='280535afeca94ec2919ecfa36a9e26b7',uuid=f185f08b-ea86-40f4-af2b-95badfddca27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Converting VIF {"id": "48790b5c-36b5-4f62-917c-7d6895779497", "address": "fa:16:3e:b4:63:ad", "network": {"id": "45abb6e8-1123-46aa-ae2f-ebd635826ffe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1153396022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae966ad209f94612b452b66061acef49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48790b5c-36", "ovs_interfaceid": "48790b5c-36b5-4f62-917c-7d6895779497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:63:ad,bridge_name='br-int',has_traffic_filtering=True,id=48790b5c-36b5-4f62-917c-7d6895779497,network=Network(45abb6e8-1123-46aa-ae2f-ebd635826ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48790b5c-36') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_vif [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:63:ad,bridge_name='br-int',has_traffic_filtering=True,id=48790b5c-36b5-4f62-917c-7d6895779497,network=Network(45abb6e8-1123-46aa-ae2f-ebd635826ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48790b5c-36') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48790b5c-36, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70ab0b13-72b6-4e47-8bdb-9e0ef38055eb) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:10:19 user nova-compute[75205]: INFO os_vif [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:63:ad,bridge_name='br-int',has_traffic_filtering=True,id=48790b5c-36b5-4f62-917c-7d6895779497,network=Network(45abb6e8-1123-46aa-ae2f-ebd635826ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48790b5c-36')
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDZViIRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:19 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[655ea7eb-079a-4efa-afac-97bc7b7827d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:10:19 user nova-compute[75205]: No targets found.
Nov 14 19:10:19 user nova-compute[75205]: iSNS:
Nov 14 19:10:19 user nova-compute[75205]: No targets found.
Nov 14 19:10:19 user nova-compute[75205]: STATIC:
Nov 14 19:10:19 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6
Nov 14 19:10:19 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:19 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:19 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979
Nov 14 19:10:19 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:19 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:19 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb
Nov 14 19:10:19 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:19 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:19 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:10:19 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:19 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:19 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76
Nov 14 19:10:19 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:19 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:19 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83
Nov 14 19:10:19 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:19 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:19 user nova-compute[75205]: FIRMWARE:
Nov 14 19:10:19 user nova-compute[75205]: No targets found.
Nov 14 19:10:19 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:10:19 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:10:19 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc36afd8-08c4-44d7-adad-068e3661e130]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03989fb-3aaa-4794-9387-0a2f35fd5ea7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:19 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:19 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:19 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:19 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:19 user nova-compute[75205]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 (non-flash)
Nov 14 19:10:19 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:19 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:19 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:19 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:19 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:19 user nova-compute[75205]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 (non-flash)
Nov 14 19:10:19 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb74618280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83'): ({'sdg'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Removing single pathed devices sdg {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d28f3ae-4ac1-4017-9e6a-1b1ee5a01c18]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b669ff7-bcb2-49a5-ac5c-4e0741b5cae2]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Flushing IO for device /dev/sdg {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.011s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[61414210-a021-47f0-8398-ef09507fbb8d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[643779e1-7eed-4d06-9a09-8cd74cbeb572]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] SCSI volumes sdg have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphvtfnz2j/b6610c225621403c9092ae0680e9de91.delta 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a86666b-1534-4d79-acf0-29deda9b7af5]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphvtfnz2j/b6610c225621403c9092ae0680e9de91.delta 1073741824" returned: 0 in 0.047s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff537419-5e87-4858-965c-e71ecdef93e9]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83, portal: 172.16.0.220,3260]
Nov 14 19:10:19 user nova-compute[75205]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83, portal: 172.16.0.220,3260] successful.
Nov 14 19:10:19 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3938b513-43d8-4c6a-8725-b903cc427e83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af69e24-7c43-4dab-98e4-e02bbd90852b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] <== disconnect_volume: return (442ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:10:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Deleting instance files /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27_del
Nov 14 19:10:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Deletion of /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27_del complete
Nov 14 19:10:19 user nova-compute[75205]: INFO nova.compute.manager [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json" returned: 1 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk --force-share --output=json' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:19 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000001, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/f185f08b-ea86-40f4-af2b-95badfddca27/disk
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:10:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-e70b3c22-a32a-4bfe-9485-a02a7eefe1b5 req-4c204e39-8173-42b1-99c8-2d200b2bbebc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received event network-changed-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-e70b3c22-a32a-4bfe-9485-a02a7eefe1b5 req-4c204e39-8173-42b1-99c8-2d200b2bbebc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Refreshing instance network info cache due to event network-changed-e7dabbdd-806b-444d-87a4-0e944c8f8a88. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e70b3c22-a32a-4bfe-9485-a02a7eefe1b5 req-4c204e39-8173-42b1-99c8-2d200b2bbebc service nova] Acquiring lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e70b3c22-a32a-4bfe-9485-a02a7eefe1b5 req-4c204e39-8173-42b1-99c8-2d200b2bbebc service nova] Acquired lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.network.neutron [req-e70b3c22-a32a-4bfe-9485-a02a7eefe1b5 req-4c204e39-8173-42b1-99c8-2d200b2bbebc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Refreshing network info cache for port e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-b93a1ca5-7cb3-46b4-84f3-03ee86e9435a req-641f64d2-5cca-4f2a-8d45-627a0a30872f service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Received event network-vif-deleted-48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:20 user nova-compute[75205]: INFO nova.compute.manager [req-b93a1ca5-7cb3-46b4-84f3-03ee86e9435a req-641f64d2-5cca-4f2a-8d45-627a0a30872f service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Neutron deleted interface 48790b5c-36b5-4f62-917c-7d6895779497; detaching it from the instance and deleting it from the info cache
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.network.neutron [req-b93a1ca5-7cb3-46b4-84f3-03ee86e9435a req-641f64d2-5cca-4f2a-8d45-627a0a30872f service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:20 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Took 0.77 seconds to deallocate network for instance.
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-b93a1ca5-7cb3-46b4-84f3-03ee86e9435a req-641f64d2-5cca-4f2a-8d45-627a0a30872f service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Detach interface failed, port_id=48790b5c-36b5-4f62-917c-7d6895779497, reason: Instance f185f08b-ea86-40f4-af2b-95badfddca27 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-1f3887c7-cca9-4628-a92d-84b04eeba303 req-2ca8ae93-53ad-4cd6-be33-512c853e17ce service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Received event network-vif-plugged-48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1f3887c7-cca9-4628-a92d-84b04eeba303 req-2ca8ae93-53ad-4cd6-be33-512c853e17ce service nova] Acquiring lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1f3887c7-cca9-4628-a92d-84b04eeba303 req-2ca8ae93-53ad-4cd6-be33-512c853e17ce service nova] Lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1f3887c7-cca9-4628-a92d-84b04eeba303 req-2ca8ae93-53ad-4cd6-be33-512c853e17ce service nova] Lock "f185f08b-ea86-40f4-af2b-95badfddca27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-1f3887c7-cca9-4628-a92d-84b04eeba303 req-2ca8ae93-53ad-4cd6-be33-512c853e17ce service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] No waiting events found dispatching network-vif-plugged-48790b5c-36b5-4f62-917c-7d6895779497 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:10:20 user nova-compute[75205]: WARNING nova.compute.manager [req-1f3887c7-cca9-4628-a92d-84b04eeba303 req-2ca8ae93-53ad-4cd6-be33-512c853e17ce service nova] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Received unexpected event network-vif-plugged-48790b5c-36b5-4f62-917c-7d6895779497 for instance with vm_state active and task_state deleting.
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.network.neutron [req-e70b3c22-a32a-4bfe-9485-a02a7eefe1b5 req-4c204e39-8173-42b1-99c8-2d200b2bbebc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Updated VIF entry in instance network info cache for port e7dabbdd-806b-444d-87a4-0e944c8f8a88. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.network.neutron [req-e70b3c22-a32a-4bfe-9485-a02a7eefe1b5 req-4c204e39-8173-42b1-99c8-2d200b2bbebc service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Updating instance_info_cache with network_info: [{"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:10:20 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e70b3c22-a32a-4bfe-9485-a02a7eefe1b5 req-4c204e39-8173-42b1-99c8-2d200b2bbebc service nova] Releasing lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphvtfnz2j/b6610c225621403c9092ae0680e9de91.delta /opt/stack/data/nova/instances/snapshots/tmphvtfnz2j/b6610c225621403c9092ae0680e9de91 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphvtfnz2j/b6610c225621403c9092ae0680e9de91.delta /opt/stack/data/nova/instances/snapshots/tmphvtfnz2j/b6610c225621403c9092ae0680e9de91" returned: 0 in 0.235s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Snapshot extracted, beginning image upload
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:22 user nova-compute[75205]: INFO nova.compute.manager [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] [instance: f185f08b-ea86-40f4-af2b-95badfddca27] Took 1.37 seconds to detach 1 volumes for instance.
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:22 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Deleted allocations for instance f185f08b-ea86-40f4-af2b-95badfddca27
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ad71115a-7b44-42b3-bca0-21cc35ec6725 tempest-DeleteServersTestJSON-2128794415 tempest-DeleteServersTestJSON-2128794415-project-member] Lock "f185f08b-ea86-40f4-af2b-95badfddca27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.263s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:23 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:10:23 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7013MB free_disk=25.525012969970703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'flavor' on Instance uuid 2d89bc07-90a1-49ef-8d67-e7263bd06e6d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1f24f442-1547-4f20-ba7c-f7790dcc37af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance b2696233-b1c2-466d-92f1-0a30c3db1501 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance aa9e5564-b68f-42b4-9263-709641bde28b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 622d19bf-0618-49a9-9f71-b632d9e11301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7d9eda42-5048-4838-820b-45844f8e59b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 26a6a013-500d-4502-a9f1-cffef3c4ba27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:23 user nova-compute[75205]: INFO nova.compute.manager [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Attaching volume 7ff8caf6-fb6d-479b-a255-66d010cfa519 to /dev/vdb
Nov 14 19:10:23 user nova-compute[75205]: DEBUG os_brick.utils [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d05267-da1d-40c0-b635-797f73ae8f3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd615d61-23c1-4ba9-bb0a-05e471183a1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[10df688e-6328-40c3-beaf-1e197d6db2f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e624f-59fa-42ec-b34b-dd854142295a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:23 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4cd160-3360-47ed-b84f-c9130839f035]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG os_brick.utils [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Updating existing volume attachment record: 8b72b127-d2c3-47dc-9aed-7b323695b7af {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:10:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:24 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Snapshot image upload complete
Nov 14 19:10:24 user nova-compute[75205]: INFO nova.compute.manager [None req-3463bbfc-776d-43cf-a5ee-a893e6a74871 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Took 5.79 seconds to snapshot the instance on the hypervisor.
Nov 14 19:10:24 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:10:24 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:10:24 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:10:24 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:10:24 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:10:24 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:10:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frjDzlUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:28 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:28 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:28 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2768ea5d-ed44-4026-ac13-9b403a107561]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:10:28 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab2c3a9-8cee-4e1e-8aac-d8ea48375eff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519] added
Nov 14 19:10:28 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dc58b0-b0c0-4e4a-8c03-d01bff953ec0]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea878704-3877-4405-887f-33798fd78e3e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frjDzlUX {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frjDzlUX" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[13784980-05f4-4e7d-9892-b674d111b68f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'frjDzlUX'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f00d16-635e-4e79-b30b-55de0661424b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb24bb3-77a7-40bb-ad44-a8c97100751b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:28 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:28 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:28 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:28 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:28 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:28 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:28 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:28 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:28 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:28 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --login" returned: 0 in 1.070s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[803d62cd-fbb8-4121-86ea-094ddeefc92a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519, portal: 172.16.0.220,3260]
Nov 14 19:10:29 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519, portal: 172.16.0.220,3260] successful.
Nov 14 19:10:29 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaa191e-36f6-463d-8e60-b9186c4e7ab6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedf635c-7747-414f-981d-5d0f24f4dc4c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:29 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:29 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:29 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:29 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:29 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:29 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:29 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:29 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:29 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:29 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:29 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:29 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.282s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3383368-2064-4818-9fea-eff987fdb3cd]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:29 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:10:30 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:10:30 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frjDzlUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:10:30 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.311s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:30 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] <== connect_volume: return (2312ms) {'type': 'block', 'scsi_wwn': '23131356436306530', 'path': '/dev/sdg'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131356436306530', 'path': '/dev/sdg'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:10:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'flavor' on Instance uuid 2d89bc07-90a1-49ef-8d67-e7263bd06e6d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:10:30 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:30 user nova-compute[75205]:   <source dev="/dev/sdg"/>
Nov 14 19:10:30 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:30 user nova-compute[75205]:   <serial>7ff8caf6-fb6d-479b-a255-66d010cfa519</serial>
Nov 14 19:10:30 user nova-compute[75205]: </disk>
Nov 14 19:10:30 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:10:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No VIF found with MAC fa:16:3e:7b:8e:52, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:10:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9f899919-ad23-4e4b-b84b-1624cef2ea2b tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.591s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-56e11011-68f5-498f-b809-6db0f68b500c req-80605e9b-ac67-4ab0-83eb-283efa7f6558 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received event network-changed-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-56e11011-68f5-498f-b809-6db0f68b500c req-80605e9b-ac67-4ab0-83eb-283efa7f6558 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Refreshing instance network info cache due to event network-changed-ff69d5ef-6600-4426-a4e1-f0116599ebfc. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:10:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-56e11011-68f5-498f-b809-6db0f68b500c req-80605e9b-ac67-4ab0-83eb-283efa7f6558 service nova] Acquiring lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-56e11011-68f5-498f-b809-6db0f68b500c req-80605e9b-ac67-4ab0-83eb-283efa7f6558 service nova] Acquired lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:34 user nova-compute[75205]: DEBUG nova.network.neutron [req-56e11011-68f5-498f-b809-6db0f68b500c req-80605e9b-ac67-4ab0-83eb-283efa7f6558 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Refreshing network info cache for port ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG nova.compute.manager [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG nova.network.neutron [req-56e11011-68f5-498f-b809-6db0f68b500c req-80605e9b-ac67-4ab0-83eb-283efa7f6558 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Updated VIF entry in instance network info cache for port ff69d5ef-6600-4426-a4e1-f0116599ebfc. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG nova.network.neutron [req-56e11011-68f5-498f-b809-6db0f68b500c req-80605e9b-ac67-4ab0-83eb-283efa7f6558 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Updating instance_info_cache with network_info: [{"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-56e11011-68f5-498f-b809-6db0f68b500c req-80605e9b-ac67-4ab0-83eb-283efa7f6558 service nova] Releasing lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:10:35 user nova-compute[75205]: INFO nova.compute.claims [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Claim successful on node user
Nov 14 19:10:35 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:35 user nova-compute[75205]: DEBUG nova.compute.manager [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.compute.manager [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.network.neutron [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:36 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.compute.manager [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.policy [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '792e949c53df4fe390f93c0118590bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42501d5d4964f49b8fe62e9c9c2bd24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.compute.manager [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:10:36 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Creating image(s)
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "/opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "/opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "/opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lazy-loading 'flavor' on Instance uuid 1f24f442-1547-4f20-ba7c-f7790dcc37af {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk 1073741824" returned: 0 in 0.049s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.network.neutron [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Successfully created port: 39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:36 user nova-compute[75205]: INFO nova.compute.manager [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Attaching volume 94eef31a-715c-4093-b81e-fb3dc2b09b36 to /dev/vdb
Nov 14 19:10:36 user nova-compute[75205]: DEBUG os_brick.utils [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ccd2b0-398c-4d38-a423-2ccf6258a3b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8993d2-b977-423d-bfbf-0108a48485be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c9d8e2-0629-426f-bf5d-22adbc484507]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03527b1-b6ae-448b-b6d2-edf332849923]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.201s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:36 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab4b7b6-ac56-4153-aad4-88078be297ef]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG os_brick.utils [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Updating existing volume attachment record: 9cfd553c-3e33-438d-a890-f394d46720ce {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:36 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Cannot resize image /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Ensure instance console log exists: /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.neutron [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Successfully updated port: 39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "refresh_cache-d66f2088-97a5-4fff-9c0c-3b89b61a2870" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquired lock "refresh_cache-d66f2088-97a5-4fff-9c0c-3b89b61a2870" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.neutron [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-722e0043-f20e-4a95-a461-9886d062645b req-d4ab51dd-d34f-4882-83d0-cc14c5af0c1e service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received event network-changed-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-722e0043-f20e-4a95-a461-9886d062645b req-d4ab51dd-d34f-4882-83d0-cc14c5af0c1e service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Refreshing instance network info cache due to event network-changed-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-722e0043-f20e-4a95-a461-9886d062645b req-d4ab51dd-d34f-4882-83d0-cc14c5af0c1e service nova] Acquiring lock "refresh_cache-d66f2088-97a5-4fff-9c0c-3b89b61a2870" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.neutron [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.neutron [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Updating instance_info_cache with network_info: [{"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Releasing lock "refresh_cache-d66f2088-97a5-4fff-9c0c-3b89b61a2870" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Instance network_info: |[{"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-722e0043-f20e-4a95-a461-9886d062645b req-d4ab51dd-d34f-4882-83d0-cc14c5af0c1e service nova] Acquired lock "refresh_cache-d66f2088-97a5-4fff-9c0c-3b89b61a2870" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.neutron [req-722e0043-f20e-4a95-a461-9886d062645b req-d4ab51dd-d34f-4882-83d0-cc14c5af0c1e service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Refreshing network info cache for port 39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Start _get_guest_xml network_info=[{"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:10:37 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:10:37 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:10:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1304396906',display_name='tempest-AttachVolumeNegativeTest-server-1304396906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1304396906',id=12,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaUfb5XjIN+dYWwErAg2vY14tbQym9SXcdo6iLUsJVmLRUBtC6hnkGvPyjWsdrDPaDYBvhoC4L5g5sXf7iRuczt8MWi6VhlbR3GVQJYKczXFf/L552UX2hcF+5DsJ052w==',key_name='tempest-keypair-725135764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-j0s503li',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:10:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=d66f2088-97a5-4fff-9c0c-3b89b61a2870,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:00:16,bridge_name='br-int',has_traffic_filtering=True,id=39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39efb8fb-4c') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.objects.instance [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'pci_devices' on Instance uuid d66f2088-97a5-4fff-9c0c-3b89b61a2870 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:10:37 user nova-compute[75205]:   <uuid>d66f2088-97a5-4fff-9c0c-3b89b61a2870</uuid>
Nov 14 19:10:37 user nova-compute[75205]:   <name>instance-0000000c</name>
Nov 14 19:10:37 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:10:37 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:10:37 user nova-compute[75205]:   <metadata>
Nov 14 19:10:37 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:10:37 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:10:37 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1304396906</nova:name>
Nov 14 19:10:37 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:10:37</nova:creationTime>
Nov 14 19:10:37 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:10:37 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:10:37 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:10:37 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:10:37 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:10:37 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:10:37 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:10:37 user nova-compute[75205]:       <nova:owner>
Nov 14 19:10:37 user nova-compute[75205]:         <nova:user uuid="792e949c53df4fe390f93c0118590bb6">tempest-AttachVolumeNegativeTest-1777396465-project-member</nova:user>
Nov 14 19:10:37 user nova-compute[75205]:         <nova:project uuid="d42501d5d4964f49b8fe62e9c9c2bd24">tempest-AttachVolumeNegativeTest-1777396465</nova:project>
Nov 14 19:10:37 user nova-compute[75205]:       </nova:owner>
Nov 14 19:10:37 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:10:37 user nova-compute[75205]:       <nova:ports>
Nov 14 19:10:37 user nova-compute[75205]:         <nova:port uuid="39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd">
Nov 14 19:10:37 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 19:10:37 user nova-compute[75205]:         </nova:port>
Nov 14 19:10:37 user nova-compute[75205]:       </nova:ports>
Nov 14 19:10:37 user nova-compute[75205]:     </nova:instance>
Nov 14 19:10:37 user nova-compute[75205]:   </metadata>
Nov 14 19:10:37 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:10:37 user nova-compute[75205]:     <system>
Nov 14 19:10:37 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:10:37 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:10:37 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:10:37 user nova-compute[75205]:       <entry name="serial">d66f2088-97a5-4fff-9c0c-3b89b61a2870</entry>
Nov 14 19:10:37 user nova-compute[75205]:       <entry name="uuid">d66f2088-97a5-4fff-9c0c-3b89b61a2870</entry>
Nov 14 19:10:37 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:10:37 user nova-compute[75205]:     </system>
Nov 14 19:10:37 user nova-compute[75205]:   </sysinfo>
Nov 14 19:10:37 user nova-compute[75205]:   <os>
Nov 14 19:10:37 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:10:37 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:10:37 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:10:37 user nova-compute[75205]:   </os>
Nov 14 19:10:37 user nova-compute[75205]:   <features>
Nov 14 19:10:37 user nova-compute[75205]:     <acpi/>
Nov 14 19:10:37 user nova-compute[75205]:     <apic/>
Nov 14 19:10:37 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:10:37 user nova-compute[75205]:   </features>
Nov 14 19:10:37 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:10:37 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:10:37 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:10:37 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:10:37 user nova-compute[75205]:   </clock>
Nov 14 19:10:37 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:10:37 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:10:37 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:10:37 user nova-compute[75205]:   </cpu>
Nov 14 19:10:37 user nova-compute[75205]:   <devices>
Nov 14 19:10:37 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:10:37 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:10:37 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk"/>
Nov 14 19:10:37 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:10:37 user nova-compute[75205]:     </disk>
Nov 14 19:10:37 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:10:37 user nova-compute[75205]:       <mac address="fa:16:3e:a2:00:16"/>
Nov 14 19:10:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:10:37 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:10:37 user nova-compute[75205]:       <target dev="tap39efb8fb-4c"/>
Nov 14 19:10:37 user nova-compute[75205]:     </interface>
Nov 14 19:10:37 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:10:37 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/console.log" append="off"/>
Nov 14 19:10:37 user nova-compute[75205]:     </serial>
Nov 14 19:10:37 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:10:37 user nova-compute[75205]:     <video>
Nov 14 19:10:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:10:37 user nova-compute[75205]:     </video>
Nov 14 19:10:37 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:10:37 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:10:37 user nova-compute[75205]:     </rng>
Nov 14 19:10:37 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:10:37 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:10:37 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:10:37 user nova-compute[75205]:     </memballoon>
Nov 14 19:10:37 user nova-compute[75205]:   </devices>
Nov 14 19:10:37 user nova-compute[75205]: </domain>
Nov 14 19:10:37 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:10:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1304396906',display_name='tempest-AttachVolumeNegativeTest-server-1304396906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1304396906',id=12,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaUfb5XjIN+dYWwErAg2vY14tbQym9SXcdo6iLUsJVmLRUBtC6hnkGvPyjWsdrDPaDYBvhoC4L5g5sXf7iRuczt8MWi6VhlbR3GVQJYKczXFf/L552UX2hcF+5DsJ052w==',key_name='tempest-keypair-725135764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-j0s503li',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:10:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=d66f2088-97a5-4fff-9c0c-3b89b61a2870,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:00:16,bridge_name='br-int',has_traffic_filtering=True,id=39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39efb8fb-4c') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG os_vif [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:00:16,bridge_name='br-int',has_traffic_filtering=True,id=39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39efb8fb-4c') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed1f7078-e826-5e51-b53d-78c8ed126243', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39efb8fb-4c, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39efb8fb-4c, col_values=(('qos', UUID('3025ddb0-4d60-466d-98ac-dc96df9e8cd3')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39efb8fb-4c, col_values=(('external_ids', {'iface-id': '39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:00:16', 'vm-uuid': 'd66f2088-97a5-4fff-9c0c-3b89b61a2870'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:37 user nova-compute[75205]: INFO os_vif [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:00:16,bridge_name='br-int',has_traffic_filtering=True,id=39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39efb8fb-4c')
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No VIF found with MAC fa:16:3e:a2:00:16, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.neutron [req-722e0043-f20e-4a95-a461-9886d062645b req-d4ab51dd-d34f-4882-83d0-cc14c5af0c1e service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Updated VIF entry in instance network info cache for port 39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG nova.network.neutron [req-722e0043-f20e-4a95-a461-9886d062645b req-d4ab51dd-d34f-4882-83d0-cc14c5af0c1e service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Updating instance_info_cache with network_info: [{"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-722e0043-f20e-4a95-a461-9886d062645b req-d4ab51dd-d34f-4882-83d0-cc14c5af0c1e service nova] Releasing lock "refresh_cache-d66f2088-97a5-4fff-9c0c-3b89b61a2870" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-44d98480-1e08-4347-b7cf-78db36ed3b69 req-abb3722f-cd5e-4f97-bf69-3f7b3b74e6c4 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-changed-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-44d98480-1e08-4347-b7cf-78db36ed3b69 req-abb3722f-cd5e-4f97-bf69-3f7b3b74e6c4 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Refreshing instance network info cache due to event network-changed-56984858-000b-45d7-a6f0-13dc113e14f6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-44d98480-1e08-4347-b7cf-78db36ed3b69 req-abb3722f-cd5e-4f97-bf69-3f7b3b74e6c4 service nova] Acquiring lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-44d98480-1e08-4347-b7cf-78db36ed3b69 req-abb3722f-cd5e-4f97-bf69-3f7b3b74e6c4 service nova] Acquired lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-44d98480-1e08-4347-b7cf-78db36ed3b69 req-abb3722f-cd5e-4f97-bf69-3f7b3b74e6c4 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Refreshing network info cache for port 56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-d70e3e2c-3e5b-4a0e-8b42-b089b15bd860 req-d9cc3508-36d1-46c6-8442-672fbbb4f6b2 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received event network-vif-plugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d70e3e2c-3e5b-4a0e-8b42-b089b15bd860 req-d9cc3508-36d1-46c6-8442-672fbbb4f6b2 service nova] Acquiring lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d70e3e2c-3e5b-4a0e-8b42-b089b15bd860 req-d9cc3508-36d1-46c6-8442-672fbbb4f6b2 service nova] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d70e3e2c-3e5b-4a0e-8b42-b089b15bd860 req-d9cc3508-36d1-46c6-8442-672fbbb4f6b2 service nova] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-d70e3e2c-3e5b-4a0e-8b42-b089b15bd860 req-d9cc3508-36d1-46c6-8442-672fbbb4f6b2 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] No waiting events found dispatching network-vif-plugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:10:39 user nova-compute[75205]: WARNING nova.compute.manager [req-d70e3e2c-3e5b-4a0e-8b42-b089b15bd860 req-d9cc3508-36d1-46c6-8442-672fbbb4f6b2 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received unexpected event network-vif-plugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd for instance with vm_state building and task_state spawning.
Nov 14 19:10:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "interface-b2696233-b1c2-466d-92f1-0a30c3db1501-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "interface-b2696233-b1c2-466d-92f1-0a30c3db1501-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lazy-loading 'flavor' on Instance uuid b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-44d98480-1e08-4347-b7cf-78db36ed3b69 req-abb3722f-cd5e-4f97-bf69-3f7b3b74e6c4 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updated VIF entry in instance network info cache for port 56984858-000b-45d7-a6f0-13dc113e14f6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-44d98480-1e08-4347-b7cf-78db36ed3b69 req-abb3722f-cd5e-4f97-bf69-3f7b3b74e6c4 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updating instance_info_cache with network_info: [{"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-44d98480-1e08-4347-b7cf-78db36ed3b69 req-abb3722f-cd5e-4f97-bf69-3f7b3b74e6c4 service nova] Releasing lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:39 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lazy-loading 'pci_requests' on Instance uuid b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:40 user nova-compute[75205]: DEBUG nova.objects.base [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Object Instance<b2696233-b1c2-466d-92f1-0a30c3db1501> lazy-loaded attributes: flavor,pci_requests {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:10:40 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:10:40 user nova-compute[75205]: DEBUG nova.policy [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65487f5c81204b0d86821d4a0eec289c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaa2f5d6a94a368051677cc0d85b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:10:40 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Successfully created port: 8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Successfully updated port: 8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquired lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:10:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Instance spawned successfully.
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received event network-vif-plugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] Acquiring lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] No waiting events found dispatching network-vif-plugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:10:41 user nova-compute[75205]: WARNING nova.compute.manager [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received unexpected event network-vif-plugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd for instance with vm_state building and task_state spawning.
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-changed-8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Refreshing instance network info cache due to event network-changed-8abdb7de-37af-4d8f-986b-a37a25d32001. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] Acquiring lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:41 user nova-compute[75205]: INFO nova.compute.manager [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:10:41 user nova-compute[75205]: INFO nova.compute.manager [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Took 6.35 seconds to build instance.
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-293120aa-b546-43f6-935f-3f6ff288ef2c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updating instance_info_cache with network_info: [{"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCAvbUXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:41 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:41 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:41 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Releasing lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] Acquired lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.network.neutron [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Refreshing network info cache for port 8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923454376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923454376',id=6,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkRIwsBeDyQ11FuXQIwqoygHpHsgf3Cdt8fX3locV211FBgH9EBzW/BZRFfpB5sEUt5eCT8S2LhivMEVz8NcFsdFBPYZakdFldF/6rJgd/n1gME/tmQkgZpjcxprOgRtg==',key_name='tempest-keypair-1747689188',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='11eaa2f5d6a94a368051677cc0d85b33',ramdisk_id='',reservation_id='r-nrqchh9b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-551564993',owner_user_name='tempest-TaggedAttachmentsTest-551564993-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65487f5c81204b0d86821d4a0eec289c',uuid=b2696233-b1c2-466d-92f1-0a30c3db1501,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converting VIF {"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_vif [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2602ad62-675c-410e-a18b-beb68e3cdda2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04c8bf53-f20d-500f-b44c-08eae6375dc8', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:10:41 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8abdb7de-37, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8abdb7de-37, col_values=(('qos', UUID('492f51e6-1730-478a-999c-93f2f3b2a287')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8abdb7de-37, col_values=(('external_ids', {'iface-id': '8abdb7de-37af-4d8f-986b-a37a25d32001', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:c0:58', 'vm-uuid': 'b2696233-b1c2-466d-92f1-0a30c3db1501'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a36b50-e9f9-4750-aa78-c523a54e6ec4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36] added
Nov 14 19:10:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:41 user nova-compute[75205]: INFO os_vif [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37')
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923454376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923454376',id=6,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkRIwsBeDyQ11FuXQIwqoygHpHsgf3Cdt8fX3locV211FBgH9EBzW/BZRFfpB5sEUt5eCT8S2LhivMEVz8NcFsdFBPYZakdFldF/6rJgd/n1gME/tmQkgZpjcxprOgRtg==',key_name='tempest-keypair-1747689188',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='11eaa2f5d6a94a368051677cc0d85b33',ramdisk_id='',reservation_id='r-nrqchh9b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-551564993',owner_user_name='tempest-TaggedAttachmentsTest-551564993-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65487f5c81204b0d86821d4a0eec289c',uuid=b2696233-b1c2-466d-92f1-0a30c3db1501,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converting VIF {"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] attach device xml: <interface type="ethernet">
Nov 14 19:10:41 user nova-compute[75205]:   <mac address="fa:16:3e:b9:c0:58"/>
Nov 14 19:10:41 user nova-compute[75205]:   <model type="virtio"/>
Nov 14 19:10:41 user nova-compute[75205]:   <mtu size="1442"/>
Nov 14 19:10:41 user nova-compute[75205]:   <target dev="tap8abdb7de-37"/>
Nov 14 19:10:41 user nova-compute[75205]: </interface>
Nov 14 19:10:41 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[71828f77-89ba-4c32-bba4-1dcf7e25c0bb]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96acf9d-f879-4eab-846b-90991d79f041]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCAvbUXw {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCAvbUXw" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9558a901-9daf-4e6b-b65a-d4feb13194fd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uCAvbUXw'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a5460a-422c-4684-b2db-621241382284]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daabb93-edb2-4fe4-9a99-83f0ac85b630]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:41 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:41 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:41 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:41 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:41 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:41 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:41 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:41 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:41 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:41 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c371577-8f03-4f1f-9392-6b5371c0cc0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36, portal: 172.16.0.220,3260]
Nov 14 19:10:41 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36, portal: 172.16.0.220,3260] successful.
Nov 14 19:10:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ada90f-7ce5-471a-bcca-49cbc040b05b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77b66ac-bf0c-4b48-9178-68f7ea753e68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:42 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa886f9-702e-49ba-b89a-6fed1f54b226]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCAvbUXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-baf4ed6c-6db4-456d-95e4-11c65fdae2a0 req-91d652ce-7aea-4dc2-80ae-39af69f48803 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-plugged-8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-baf4ed6c-6db4-456d-95e4-11c65fdae2a0 req-91d652ce-7aea-4dc2-80ae-39af69f48803 service nova] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-baf4ed6c-6db4-456d-95e4-11c65fdae2a0 req-91d652ce-7aea-4dc2-80ae-39af69f48803 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-baf4ed6c-6db4-456d-95e4-11c65fdae2a0 req-91d652ce-7aea-4dc2-80ae-39af69f48803 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-baf4ed6c-6db4-456d-95e4-11c65fdae2a0 req-91d652ce-7aea-4dc2-80ae-39af69f48803 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] No waiting events found dispatching network-vif-plugged-8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:10:42 user nova-compute[75205]: WARNING nova.compute.manager [req-baf4ed6c-6db4-456d-95e4-11c65fdae2a0 req-91d652ce-7aea-4dc2-80ae-39af69f48803 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received unexpected event network-vif-plugged-8abdb7de-37af-4d8f-986b-a37a25d32001 for instance with vm_state active and task_state None.
Nov 14 19:10:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] No BDM found with device name hda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] No VIF found with MAC fa:16:3e:e0:1f:1e, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updated VIF entry in instance network info cache for port 8abdb7de-37af-4d8f-986b-a37a25d32001. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updating instance_info_cache with network_info: [{"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bd51be37-626d-4a03-b4a7-d56e870ab7b8 req-d56fc095-d13d-4f2f-b91e-eb42cf0ab781 service nova] Releasing lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:10:42 user nova-compute[75205]:   <nova:package version="0.0.0"/>
Nov 14 19:10:42 user nova-compute[75205]:   <nova:name>tempest-device-tagging-server-923454376</nova:name>
Nov 14 19:10:42 user nova-compute[75205]:   <nova:creationTime>2023-11-14 19:10:42</nova:creationTime>
Nov 14 19:10:42 user nova-compute[75205]:   <nova:flavor name="m1.tiny">
Nov 14 19:10:42 user nova-compute[75205]:     <nova:memory>512</nova:memory>
Nov 14 19:10:42 user nova-compute[75205]:     <nova:disk>1</nova:disk>
Nov 14 19:10:42 user nova-compute[75205]:     <nova:swap>0</nova:swap>
Nov 14 19:10:42 user nova-compute[75205]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:10:42 user nova-compute[75205]:     <nova:vcpus>1</nova:vcpus>
Nov 14 19:10:42 user nova-compute[75205]:   </nova:flavor>
Nov 14 19:10:42 user nova-compute[75205]:   <nova:owner>
Nov 14 19:10:42 user nova-compute[75205]:     <nova:user uuid="65487f5c81204b0d86821d4a0eec289c">tempest-TaggedAttachmentsTest-551564993-project-member</nova:user>
Nov 14 19:10:42 user nova-compute[75205]:     <nova:project uuid="11eaa2f5d6a94a368051677cc0d85b33">tempest-TaggedAttachmentsTest-551564993</nova:project>
Nov 14 19:10:42 user nova-compute[75205]:   </nova:owner>
Nov 14 19:10:42 user nova-compute[75205]:   <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:10:42 user nova-compute[75205]:   <nova:ports>
Nov 14 19:10:42 user nova-compute[75205]:     <nova:port uuid="56984858-000b-45d7-a6f0-13dc113e14f6">
Nov 14 19:10:42 user nova-compute[75205]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:10:42 user nova-compute[75205]:     </nova:port>
Nov 14 19:10:42 user nova-compute[75205]:     <nova:port uuid="8abdb7de-37af-4d8f-986b-a37a25d32001">
Nov 14 19:10:42 user nova-compute[75205]:       <nova:ip type="fixed" address="10.10.10.188" ipVersion="4"/>
Nov 14 19:10:42 user nova-compute[75205]:     </nova:port>
Nov 14 19:10:42 user nova-compute[75205]:   </nova:ports>
Nov 14 19:10:42 user nova-compute[75205]: </nova:instance>
Nov 14 19:10:42 user nova-compute[75205]:  {{(pid=75205) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ae6303dd-a929-4e3b-9b33-2d26092a66ee tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "interface-b2696233-b1c2-466d-92f1-0a30c3db1501-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.526s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lazy-loading 'flavor' on Instance uuid b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:42 user nova-compute[75205]: INFO nova.compute.manager [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Attaching volume 335ac66e-f430-4fb6-b61b-870da985af35 to /dev/vdb
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.utils [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a1b622-6f5c-4da7-b81b-3d0cf0fc9ef6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[026fc761-0e32-4e54-87ec-03b20e5cce99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a61d11c-fab7-445b-b86d-21ded28750d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f37c473-5ca6-4aac-b2b5-85659aa0b938]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:42 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:10:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b823d8-b25f-4b06-8682-c9bdaf5d0fc9]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG os_brick.utils [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:42 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updating existing volume attachment record: a44dc83f-a0ae-403c-a2ea-62fa3877be3d {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:10:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26237633236663464', 'path': '/dev/sdh'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237633236663464', 'path': '/dev/sdh'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:10:43 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lazy-loading 'flavor' on Instance uuid 1f24f442-1547-4f20-ba7c-f7790dcc37af {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:10:43 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:43 user nova-compute[75205]:   <source dev="/dev/sdh"/>
Nov 14 19:10:43 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:43 user nova-compute[75205]:   <serial>94eef31a-715c-4093-b81e-fb3dc2b09b36</serial>
Nov 14 19:10:43 user nova-compute[75205]: </disk>
Nov 14 19:10:43 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:10:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] No VIF found with MAC fa:16:3e:f4:dc:26, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:10:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1c67a48-bbb0-425b-adde-5f689dadc166 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.010s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-7180e568-e375-4f26-bdc1-89508fcd0760 req-7b31d0b5-acc6-4469-9ec7-b4b9203ad7b1 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-plugged-8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7180e568-e375-4f26-bdc1-89508fcd0760 req-7b31d0b5-acc6-4469-9ec7-b4b9203ad7b1 service nova] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7180e568-e375-4f26-bdc1-89508fcd0760 req-7b31d0b5-acc6-4469-9ec7-b4b9203ad7b1 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7180e568-e375-4f26-bdc1-89508fcd0760 req-7b31d0b5-acc6-4469-9ec7-b4b9203ad7b1 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-7180e568-e375-4f26-bdc1-89508fcd0760 req-7b31d0b5-acc6-4469-9ec7-b4b9203ad7b1 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] No waiting events found dispatching network-vif-plugged-8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:10:44 user nova-compute[75205]: WARNING nova.compute.manager [req-7180e568-e375-4f26-bdc1-89508fcd0760 req-7b31d0b5-acc6-4469-9ec7-b4b9203ad7b1 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received unexpected event network-vif-plugged-8abdb7de-37af-4d8f-986b-a37a25d32001 for instance with vm_state active and task_state None.
Nov 14 19:10:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-12873f4f-85f5-4cbc-80fb-7e8f5bb69e60 req-c8abc21f-83d2-43a1-8537-c84aa1a83fb3 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received event network-changed-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-12873f4f-85f5-4cbc-80fb-7e8f5bb69e60 req-c8abc21f-83d2-43a1-8537-c84aa1a83fb3 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Refreshing instance network info cache due to event network-changed-70eb67c8-84ca-42ce-b702-4699cdbc0dbb. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-12873f4f-85f5-4cbc-80fb-7e8f5bb69e60 req-c8abc21f-83d2-43a1-8537-c84aa1a83fb3 service nova] Acquiring lock "refresh_cache-aa9e5564-b68f-42b4-9263-709641bde28b" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-12873f4f-85f5-4cbc-80fb-7e8f5bb69e60 req-c8abc21f-83d2-43a1-8537-c84aa1a83fb3 service nova] Acquired lock "refresh_cache-aa9e5564-b68f-42b4-9263-709641bde28b" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG nova.network.neutron [req-12873f4f-85f5-4cbc-80fb-7e8f5bb69e60 req-c8abc21f-83d2-43a1-8537-c84aa1a83fb3 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Refreshing network info cache for port 70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Acquiring lock "aa9e5564-b68f-42b4-9263-709641bde28b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "aa9e5564-b68f-42b4-9263-709641bde28b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:44 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lazy-loading 'flavor' on Instance uuid aa9e5564-b68f-42b4-9263-709641bde28b {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "aa9e5564-b68f-42b4-9263-709641bde28b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.155s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:45 user nova-compute[75205]: INFO nova.compute.manager [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Detaching volume 94eef31a-715c-4093-b81e-fb3dc2b09b36
Nov 14 19:10:45 user nova-compute[75205]: DEBUG nova.network.neutron [req-12873f4f-85f5-4cbc-80fb-7e8f5bb69e60 req-c8abc21f-83d2-43a1-8537-c84aa1a83fb3 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Updated VIF entry in instance network info cache for port 70eb67c8-84ca-42ce-b702-4699cdbc0dbb. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG nova.network.neutron [req-12873f4f-85f5-4cbc-80fb-7e8f5bb69e60 req-c8abc21f-83d2-43a1-8537-c84aa1a83fb3 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Updating instance_info_cache with network_info: [{"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-12873f4f-85f5-4cbc-80fb-7e8f5bb69e60 req-c8abc21f-83d2-43a1-8537-c84aa1a83fb3 service nova] Releasing lock "refresh_cache-aa9e5564-b68f-42b4-9263-709641bde28b" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:45 user nova-compute[75205]: INFO nova.virt.block_device [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Attempting to driver detach volume 94eef31a-715c-4093-b81e-fb3dc2b09b36 from mountpoint /dev/vdb
Nov 14 19:10:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Attempting to detach device vdb from instance 1f24f442-1547-4f20-ba7c-f7790dcc37af from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:10:45 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:45 user nova-compute[75205]:   <source dev="/dev/sdh"/>
Nov 14 19:10:45 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:45 user nova-compute[75205]:   <serial>94eef31a-715c-4093-b81e-fb3dc2b09b36</serial>
Nov 14 19:10:45 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:10:45 user nova-compute[75205]: </disk>
Nov 14 19:10:45 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:10:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Successfully detached device vdb from instance 1f24f442-1547-4f20-ba7c-f7790dcc37af from the persistent domain config.
Nov 14 19:10:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f24f442-1547-4f20-ba7c-f7790dcc37af from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:10:45 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:45 user nova-compute[75205]:   <source dev="/dev/sdh"/>
Nov 14 19:10:45 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:45 user nova-compute[75205]:   <serial>94eef31a-715c-4093-b81e-fb3dc2b09b36</serial>
Nov 14 19:10:45 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:10:45 user nova-compute[75205]: </disk>
Nov 14 19:10:45 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Acquiring lock "aa9e5564-b68f-42b4-9263-709641bde28b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "aa9e5564-b68f-42b4-9263-709641bde28b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:45 user nova-compute[75205]: INFO nova.compute.manager [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Attaching volume a4bab1fa-8394-4619-9776-f24839f95caf to /dev/vdb
Nov 14 19:10:45 user nova-compute[75205]: DEBUG os_brick.utils [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0762b65d-9472-49b4-9b2d-6ec0b4f73c50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad426da-919b-4d19-8b71-34868ac47ebd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec32e875-8e06-48ef-a4cb-a1fa1a8b5cf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df751e-f9d5-4222-8022-dce3b5bd4aeb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:10:45 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:10:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1c8352-5561-4557-972d-676001cfdb28]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG os_brick.utils [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Updating existing volume attachment record: e37f42b5-692b-4373-a5cb-465dee8ad5e4 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:10:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f24f442-1547-4f20-ba7c-f7790dcc37af {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:10:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-88a3fb57-6b8f-4098-9956-5765612826dd req-2939ce27-1053-4000-b793-59c49831fafb service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-changed-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-88a3fb57-6b8f-4098-9956-5765612826dd req-2939ce27-1053-4000-b793-59c49831fafb service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Refreshing instance network info cache due to event network-changed-7fc6ede6-60c6-4440-a719-9397a8437fbb. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:10:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88a3fb57-6b8f-4098-9956-5765612826dd req-2939ce27-1053-4000-b793-59c49831fafb service nova] Acquiring lock "refresh_cache-622d19bf-0618-49a9-9f71-b632d9e11301" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:10:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88a3fb57-6b8f-4098-9956-5765612826dd req-2939ce27-1053-4000-b793-59c49831fafb service nova] Acquired lock "refresh_cache-622d19bf-0618-49a9-9f71-b632d9e11301" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:10:46 user nova-compute[75205]: DEBUG nova.network.neutron [req-88a3fb57-6b8f-4098-9956-5765612826dd req-2939ce27-1053-4000-b793-59c49831fafb service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Refreshing network info cache for port 7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:10:47 user nova-compute[75205]: DEBUG nova.network.neutron [req-88a3fb57-6b8f-4098-9956-5765612826dd req-2939ce27-1053-4000-b793-59c49831fafb service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Updated VIF entry in instance network info cache for port 7fc6ede6-60c6-4440-a719-9397a8437fbb. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:10:47 user nova-compute[75205]: DEBUG nova.network.neutron [req-88a3fb57-6b8f-4098-9956-5765612826dd req-2939ce27-1053-4000-b793-59c49831fafb service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Updating instance_info_cache with network_info: [{"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:10:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88a3fb57-6b8f-4098-9956-5765612826dd req-2939ce27-1053-4000-b793-59c49831fafb service nova] Releasing lock "refresh_cache-622d19bf-0618-49a9-9f71-b632d9e11301" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:10:47 user nova-compute[75205]: INFO nova.compute.manager [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Rebuilding instance
Nov 14 19:10:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ULqDQyJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:48 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:48 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:48 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[24863cd8-2343-4cd6-ad0b-54df9d6481b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:10:48 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e7cad9-fa0a-4ad0-9252-2b399edfa0da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35] added
Nov 14 19:10:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebffd338-2b7a-4855-8b3c-1feb26484122]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba261d1-682d-4b31-89d4-0e58a34bb8b9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ULqDQyJm {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ULqDQyJm" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc207ad-1c6a-45b7-8cbe-39b7a9303f31]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ULqDQyJm'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db23f45-efb8-4fae-a1c4-11494205c2bc]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e441d1e-8de5-4b85-a1d4-0fa571262d4e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf7f6c5-772b-4dce-82a9-140e490968aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35, portal: 172.16.0.220,3260]
Nov 14 19:10:48 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35, portal: 172.16.0.220,3260] successful.
Nov 14 19:10:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46294dd-0aed-496f-b2b4-62ff5e4a3a8a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f447475-de4a-49a4-881b-4da92dbea8f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f786e0f5-aaac-4782-bdf4-7cef67d7ad8a]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ULqDQyJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:10:48 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Instance destroyed successfully.
Nov 14 19:10:48 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Instance destroyed successfully.
Nov 14 19:10:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-502671428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-266304409',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuroo777PzrJhNT1Z+8Bz3bmZfqCc+/PXCXIZcuctFMhrY1Rpfi1QfSM9QpIJtELl/C4MHfcfyzeOJ7oaOGYkNsgfsiChX3EizTbvsbrCm3XCIgNnKEPubgbl6oglzwDw==',key_name='tempest-keypair-1647726640',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3325c3ab571b451da9cffb93069482f5',ramdisk_id='',reservation_id='r-7uy2l8c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-667072902',owner_user_name='tempest-ServerActionsV293TestJSON-667072902-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11e8a4105e694b14b530792142351388',uuid=622d19bf-0618-49a9-9f71-b632d9e11301,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converting VIF {"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_vif [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fc6ede6-60, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b733430f-4b60-4fd3-951b-326a5332bf6a) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:48 user nova-compute[75205]: INFO os_vif [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60')
Nov 14 19:10:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epHdMIaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:48 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 19:10:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-vif-unplugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] No waiting events found dispatching network-vif-unplugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:10:48 user nova-compute[75205]: WARNING nova.compute.manager [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received unexpected event network-vif-unplugged-7fc6ede6-60c6-4440-a719-9397a8437fbb for instance with vm_state active and task_state rebuilding.
Nov 14 19:10:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] No waiting events found dispatching network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:10:48 user nova-compute[75205]: WARNING nova.compute.manager [req-4160b3e7-568e-4dd7-acba-eb96f2538f08 req-bd195039-a9cf-4f3e-b743-00c5c18f20d8 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received unexpected event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb for instance with vm_state active and task_state rebuilding.
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26462373965626539', 'path': '/dev/sdi'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462373965626539', 'path': '/dev/sdi'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.681s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lazy-loading 'flavor' on Instance uuid b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b258fcad-a997-4f41-8eee-e0552edac0ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:10:49 user nova-compute[75205]: No targets found.
Nov 14 19:10:49 user nova-compute[75205]: iSNS:
Nov 14 19:10:49 user nova-compute[75205]: No targets found.
Nov 14 19:10:49 user nova-compute[75205]: STATIC:
Nov 14 19:10:49 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36
Nov 14 19:10:49 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:49 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:49 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6
Nov 14 19:10:49 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:49 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:49 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979
Nov 14 19:10:49 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:49 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:49 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb
Nov 14 19:10:49 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:49 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:49 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:10:49 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:49 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:49 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76
Nov 14 19:10:49 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:49 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:49 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35
Nov 14 19:10:49 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:49 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:49 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:10:49 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:49 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:49 user nova-compute[75205]: FIRMWARE:
Nov 14 19:10:49 user nova-compute[75205]: No targets found.
Nov 14 19:10:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:10:49 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:10:49 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:10:49 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:49 user nova-compute[75205]:   <source dev="/dev/sdi"/>
Nov 14 19:10:49 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:49 user nova-compute[75205]:   <serial>335ac66e-f430-4fb6-b61b-870da985af35</serial>
Nov 14 19:10:49 user nova-compute[75205]: </disk>
Nov 14 19:10:49 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bf32ae-ca84-482b-8b0b-a53ff4cc143f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cc113a-0a1f-4085-951e-891062371df6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c261510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[719a7e02-48c4-4ae1-9302-3fb75d682d68]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf5fb94-a971-48b1-9c7f-41d559dc5e49]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bb6a46-9bd0-4c31-bb3d-f59fa7a09a5a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf6a0f-2504-43c2-a4ab-249665b7458d]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d183180-ff54-4d53-bc31-f8f05be5caa4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c85377-f835-4b9d-a12a-c3d923499e48]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260]
Nov 14 19:10:49 user nova-compute[75205]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260] successful.
Nov 14 19:10:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df0e7f2-3966-40cf-a312-2c230485aa23]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] <== disconnect_volume: return (995ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:10:49 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Deleting instance files /opt/stack/data/nova/instances/622d19bf-0618-49a9-9f71-b632d9e11301_del
Nov 14 19:10:49 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Deletion of /opt/stack/data/nova/instances/622d19bf-0618-49a9-9f71-b632d9e11301_del complete
Nov 14 19:10:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] No BDM found with device name hda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] No VIF found with MAC fa:16:3e:e0:1f:1e, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:10:50 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 622d19bf-0618-49a9-9f71-b632d9e11301 could not be found.
Nov 14 19:10:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epHdMIaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:50 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[53247b66-575b-47e6-9045-f254d34ec872]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:10:50 user nova-compute[75205]: No targets found.
Nov 14 19:10:50 user nova-compute[75205]: iSNS:
Nov 14 19:10:50 user nova-compute[75205]: No targets found.
Nov 14 19:10:50 user nova-compute[75205]: STATIC:
Nov 14 19:10:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36
Nov 14 19:10:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6
Nov 14 19:10:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979
Nov 14 19:10:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb
Nov 14 19:10:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:10:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35
Nov 14 19:10:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:10:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:10:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:10:50 user nova-compute[75205]: FIRMWARE:
Nov 14 19:10:50 user nova-compute[75205]: No targets found.
Nov 14 19:10:50 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:10:50 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:10:50 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7c21af34-a544-43d2-8ed2-0d131df7d133 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.308s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a28226-f899-4109-a768-726aefdef90b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaebc16-f10e-4881-8fec-f76e2b57699f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c261870>, {}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Disconnecting from: [] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] <== disconnect_volume: return (86ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edhnzUYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:10:50 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:50 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:10:50 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4652a30-e9e1-4567-adc3-b311d5df28d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:10:50 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa7ad0f-ec29-4462-b4f3-3acbf049bcd7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf] added
Nov 14 19:10:50 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a538bb0-8c37-4d9d-899e-3e5971a4f31b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4e051b-bb35-4b62-8e40-99db93ba51b0]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edhnzUYr {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edhnzUYr" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e096a728-6910-4906-a97c-ae7201b6bb7b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edhnzUYr'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a44a24-b2bf-4096-9b1f-02eab545fd42]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6f9f9f-a23f-4b43-8c60-f455d7298455]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:50 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Preparing to wait for external event volume-reimaged-77e65258-d6ca-4db1-8633-f8f45aa20d76 {{(pid=75205) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9898a8e0-1ac1-4e84-9888-d61ccae6ffab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf, portal: 172.16.0.220,3260]
Nov 14 19:10:51 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf, portal: 172.16.0.220,3260] successful.
Nov 14 19:10:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[af190eae-85a2-42cf-aa8e-e240660bb527]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1928ede-69d0-46d3-97a9-40de3a91b1ff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:10:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f5f7fb-b595-4fb0-bf86-d632ef25dbf8]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edhnzUYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:51 user nova-compute[75205]: INFO nova.compute.manager [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Detaching volume 335ac66e-f430-4fb6-b61b-870da985af35
Nov 14 19:10:51 user nova-compute[75205]: INFO nova.virt.block_device [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Attempting to driver detach volume 335ac66e-f430-4fb6-b61b-870da985af35 from mountpoint /dev/vdb
Nov 14 19:10:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Attempting to detach device vdb from instance b2696233-b1c2-466d-92f1-0a30c3db1501 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:10:51 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:51 user nova-compute[75205]:   <source dev="/dev/sdi"/>
Nov 14 19:10:51 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:51 user nova-compute[75205]:   <serial>335ac66e-f430-4fb6-b61b-870da985af35</serial>
Nov 14 19:10:51 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 19:10:51 user nova-compute[75205]: </disk>
Nov 14 19:10:51 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:10:51 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Successfully detached device vdb from instance b2696233-b1c2-466d-92f1-0a30c3db1501 from the persistent domain config.
Nov 14 19:10:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2696233-b1c2-466d-92f1-0a30c3db1501 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:10:51 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:51 user nova-compute[75205]:   <source dev="/dev/sdi"/>
Nov 14 19:10:51 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:51 user nova-compute[75205]:   <serial>335ac66e-f430-4fb6-b61b-870da985af35</serial>
Nov 14 19:10:51 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 19:10:51 user nova-compute[75205]: </disk>
Nov 14 19:10:51 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:10:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:10:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:10:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26436303134633530', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:10:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436303134633530', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:10:52 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lazy-loading 'flavor' on Instance uuid aa9e5564-b68f-42b4-9263-709641bde28b {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 19:10:52 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:52 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:10:52 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:52 user nova-compute[75205]:   <serial>a4bab1fa-8394-4619-9776-f24839f95caf</serial>
Nov 14 19:10:52 user nova-compute[75205]: </disk>
Nov 14 19:10:52 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:10:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:10:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] No VIF found with MAC fa:16:3e:3d:d7:72, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:10:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7d2fece3-b438-4d23-bb60-c088ebe5d697 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "aa9e5564-b68f-42b4-9263-709641bde28b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.420s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:10:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-851b8a0c-bf48-4eac-8d18-216bc56cd93e tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] volume_snapshot_create: create_info: {'snapshot_id': '8dca1e64-b6bc-4f31-be42-1a2b11ec0d01', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75205) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 19:10:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-851b8a0c-bf48-4eac-8d18-216bc56cd93e tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] snap xml: <domainsnapshot>
Nov 14 19:10:53 user nova-compute[75205]:   <disks>
Nov 14 19:10:53 user nova-compute[75205]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 14 19:10:53 user nova-compute[75205]:       <source file="/dev/new_file"/>
Nov 14 19:10:53 user nova-compute[75205]:     </disk>
Nov 14 19:10:53 user nova-compute[75205]:     <disk name="vda" snapshot="no"/>
Nov 14 19:10:53 user nova-compute[75205]:   </disks>
Nov 14 19:10:53 user nova-compute[75205]: </domainsnapshot>
Nov 14 19:10:53 user nova-compute[75205]:  {{(pid=75205) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 19:10:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-851b8a0c-bf48-4eac-8d18-216bc56cd93e tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] Lazy-loading 'system_metadata' on Instance uuid aa9e5564-b68f-42b4-9263-709641bde28b {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:10:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-851b8a0c-bf48-4eac-8d18-216bc56cd93e tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [None req-851b8a0c-bf48-4eac-8d18-216bc56cd93e tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     rv = execute(f, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     six.reraise(c, e, tb)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     raise value
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     rv = meth(*args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b] 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [None req-851b8a0c-bf48-4eac-8d18-216bc56cd93e tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     self._volume_snapshot_create(context, instance, guest,
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     rv = execute(f, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     six.reraise(c, e, tb)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     raise value
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     rv = meth(*args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b] 
Nov 14 19:10:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4c40f3cd-5ace-4e10-a3dc-ba1e772d5000 tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] volume_snapshot_delete: delete_info: {'volume_id': 'a4bab1fa-8394-4619-9776-f24839f95caf'} {{(pid=75205) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [None req-4c40f3cd-5ace-4e10-a3dc-ba1e772d5000 tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b]     if delete_info['type'] != 'qcow2':
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b] KeyError: 'type'
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [instance: aa9e5564-b68f-42b4-9263-709641bde28b] 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [None req-4c40f3cd-5ace-4e10-a3dc-ba1e772d5000 tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9dc5c3bd-92e8-431b-a5dc-31ede819ce12)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver [None req-851b8a0c-bf48-4eac-8d18-216bc56cd93e tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 8dca1e64-b6bc-4f31-be42-1a2b11ec0d01 could not be found.
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 8dca1e64-b6bc-4f31-be42-1a2b11ec0d01 could not be found. (HTTP 404) (Request-ID: req-05fd550b-36c5-4da4-9020-2895639d8c36)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver 
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 8dca1e64-b6bc-4f31-be42-1a2b11ec0d01 could not be found.
Nov 14 19:10:53 user nova-compute[75205]: ERROR nova.virt.libvirt.driver 
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server [None req-4c40f3cd-5ace-4e10-a3dc-ba1e772d5000 tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] Exception during message handling: KeyError: 'type'
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server 
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server [None req-851b8a0c-bf48-4eac-8d18-216bc56cd93e tempest-VolumesAssistedSnapshotsTest-351463783 tempest-VolumesAssistedSnapshotsTest-351463783-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 19:10:53 user nova-compute[75205]: ERROR oslo_messaging.rpc.server 
Nov 14 19:10:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Acquiring lock "aa9e5564-b68f-42b4-9263-709641bde28b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:10:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "aa9e5564-b68f-42b4-9263-709641bde28b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:10:53 user nova-compute[75205]: INFO nova.compute.manager [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Detaching volume a4bab1fa-8394-4619-9776-f24839f95caf
Nov 14 19:10:53 user nova-compute[75205]: INFO nova.virt.block_device [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Attempting to driver detach volume a4bab1fa-8394-4619-9776-f24839f95caf from mountpoint /dev/vdb
Nov 14 19:10:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Attempting to detach device vdb from instance aa9e5564-b68f-42b4-9263-709641bde28b from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:10:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 19:10:53 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:53 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:10:53 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:53 user nova-compute[75205]:   <serial>a4bab1fa-8394-4619-9776-f24839f95caf</serial>
Nov 14 19:10:53 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:10:53 user nova-compute[75205]: </disk>
Nov 14 19:10:53 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:10:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Successfully detached device vdb from instance aa9e5564-b68f-42b4-9263-709641bde28b from the persistent domain config.
Nov 14 19:10:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa9e5564-b68f-42b4-9263-709641bde28b from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:10:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 19:10:53 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:10:53 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:10:53 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:10:53 user nova-compute[75205]:   <serial>a4bab1fa-8394-4619-9776-f24839f95caf</serial>
Nov 14 19:10:53 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:10:53 user nova-compute[75205]: </disk>
Nov 14 19:10:53 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:10:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa9e5564-b68f-42b4-9263-709641bde28b {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:10:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:10:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-017c76a3-5666-4108-82f9-b26572379626 req-e091fa4b-9a1d-494c-85fa-96a2dafd61fa service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-changed-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-017c76a3-5666-4108-82f9-b26572379626 req-e091fa4b-9a1d-494c-85fa-96a2dafd61fa service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing instance network info cache due to event network-changed-6ca76c67-3d07-45f3-b07f-5c997c4392d4. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-017c76a3-5666-4108-82f9-b26572379626 req-e091fa4b-9a1d-494c-85fa-96a2dafd61fa service nova] Acquiring lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-017c76a3-5666-4108-82f9-b26572379626 req-e091fa4b-9a1d-494c-85fa-96a2dafd61fa service nova] Acquired lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:02 user nova-compute[75205]: DEBUG nova.network.neutron [req-017c76a3-5666-4108-82f9-b26572379626 req-e091fa4b-9a1d-494c-85fa-96a2dafd61fa service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Refreshing network info cache for port 6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:03 user nova-compute[75205]: DEBUG nova.network.neutron [req-017c76a3-5666-4108-82f9-b26572379626 req-e091fa4b-9a1d-494c-85fa-96a2dafd61fa service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updated VIF entry in instance network info cache for port 6ca76c67-3d07-45f3-b07f-5c997c4392d4. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:11:03 user nova-compute[75205]: DEBUG nova.network.neutron [req-017c76a3-5666-4108-82f9-b26572379626 req-e091fa4b-9a1d-494c-85fa-96a2dafd61fa service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [{"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-017c76a3-5666-4108-82f9-b26572379626 req-e091fa4b-9a1d-494c-85fa-96a2dafd61fa service nova] Releasing lock "refresh_cache-7d9eda42-5048-4838-820b-45844f8e59b0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-7ffb2651-706e-48d4-a63d-99730d3b0e73 req-11f08343-71ad-46e0-842f-19e16422635f service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event volume-reimaged-77e65258-d6ca-4db1-8633-f8f45aa20d76 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7ffb2651-706e-48d4-a63d-99730d3b0e73 req-11f08343-71ad-46e0-842f-19e16422635f service nova] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7ffb2651-706e-48d4-a63d-99730d3b0e73 req-11f08343-71ad-46e0-842f-19e16422635f service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7ffb2651-706e-48d4-a63d-99730d3b0e73 req-11f08343-71ad-46e0-842f-19e16422635f service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-7ffb2651-706e-48d4-a63d-99730d3b0e73 req-11f08343-71ad-46e0-842f-19e16422635f service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Processing event volume-reimaged-77e65258-d6ca-4db1-8633-f8f45aa20d76 {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Instance event wait completed in 13 seconds for volume-reimaged {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:11:04 user nova-compute[75205]: INFO nova.virt.block_device [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Booting with volume 77e65258-d6ca-4db1-8633-f8f45aa20d76 at /dev/vda
Nov 14 19:11:04 user nova-compute[75205]: DEBUG os_brick.utils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[44215731-8b7c-4562-ae2d-27c9653fbef8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adb5d02-1875-4764-a497-3874d3f90630]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[474dc10c-5a36-4dd1-80a1-d479dae61414]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d93f7c4-20de-4b28-98e0-46c1724235d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:04 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:11:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3ddf85-e7de-4fc2-99ed-b196a685c13e]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG os_brick.utils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:04 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Updating existing volume attachment record: 611522ef-4027-437c-803e-be6c54f56374 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "7d9eda42-5048-4838-820b-45844f8e59b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:05 user nova-compute[75205]: INFO nova.compute.manager [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Terminating instance
Nov 14 19:11:05 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-ef4f96c6-9339-47df-bbc4-6391e59a6f16 req-0252d39f-73eb-4b2f-8a8c-e3510993a537 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ef4f96c6-9339-47df-bbc4-6391e59a6f16 req-0252d39f-73eb-4b2f-8a8c-e3510993a537 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ef4f96c6-9339-47df-bbc4-6391e59a6f16 req-0252d39f-73eb-4b2f-8a8c-e3510993a537 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ef4f96c6-9339-47df-bbc4-6391e59a6f16 req-0252d39f-73eb-4b2f-8a8c-e3510993a537 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-ef4f96c6-9339-47df-bbc4-6391e59a6f16 req-0252d39f-73eb-4b2f-8a8c-e3510993a537 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-unplugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-ef4f96c6-9339-47df-bbc4-6391e59a6f16 req-0252d39f-73eb-4b2f-8a8c-e3510993a537 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:05 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1f24f442-1547-4f20-ba7c-f7790dcc37af is timed out.
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Successfully detached device vdb from instance 1f24f442-1547-4f20-ba7c-f7790dcc37af from the live domain config.
Nov 14 19:11:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCAvbUXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:05 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[74440f3a-8561-4f6b-82ec-0fb1971103e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:11:05 user nova-compute[75205]: No targets found.
Nov 14 19:11:05 user nova-compute[75205]: iSNS:
Nov 14 19:11:05 user nova-compute[75205]: No targets found.
Nov 14 19:11:05 user nova-compute[75205]: STATIC:
Nov 14 19:11:05 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36
Nov 14 19:11:05 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:05 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:05 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6
Nov 14 19:11:05 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:05 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:05 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979
Nov 14 19:11:05 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:05 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:05 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb
Nov 14 19:11:05 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:05 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:05 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:11:05 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:05 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:05 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35
Nov 14 19:11:05 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:05 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:05 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:11:05 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:05 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:05 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf
Nov 14 19:11:05 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:05 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:05 user nova-compute[75205]: FIRMWARE:
Nov 14 19:11:05 user nova-compute[75205]: No targets found.
Nov 14 19:11:05 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:11:05 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:11:05 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e653d348-c4d1-4888-8194-edba86e4dfc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ee9812-c307-4308-bd10-47d69110b08f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 (non-flash)
Nov 14 19:11:05 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c27a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36'): ({'sdh'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Removing single pathed devices sdh {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fa2033-72ce-41e7-ae59-1f4c8317aa42]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5057e96a-404e-4586-be84-01ab64c57b00]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Flushing IO for device /dev/sdh {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51bcb0e-d4d2-4a34-9a97-aef85517a1ea]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab620658-8853-4ea7-9d01-60de2261661a]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] SCSI volumes sdh have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[991700ce-f345-4452-89ab-4381d9e47c54]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9df6c7-e79b-456f-bac5-2f57262d8b9a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36, portal: 172.16.0.220,3260]
Nov 14 19:11:06 user nova-compute[75205]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36, portal: 172.16.0.220,3260] successful.
Nov 14 19:11:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94eef31a-715c-4093-b81e-fb3dc2b09b36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b699c177-e00a-498e-8201-34de330b5a0a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] <== disconnect_volume: return (365ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-7c269547-f866-40be-9abc-a069921675c5 req-34447d03-84ca-48d2-8443-569991e1143f service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7c269547-f866-40be-9abc-a069921675c5 req-34447d03-84ca-48d2-8443-569991e1143f service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7c269547-f866-40be-9abc-a069921675c5 req-34447d03-84ca-48d2-8443-569991e1143f service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7c269547-f866-40be-9abc-a069921675c5 req-34447d03-84ca-48d2-8443-569991e1143f service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-7c269547-f866-40be-9abc-a069921675c5 req-34447d03-84ca-48d2-8443-569991e1143f service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-unplugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-7c269547-f866-40be-9abc-a069921675c5 req-34447d03-84ca-48d2-8443-569991e1143f service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-4baa19f5-cde9-4958-b945-93a30a85f8f1 req-4b6fd03f-702e-4021-a90e-0872635769b4 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4baa19f5-cde9-4958-b945-93a30a85f8f1 req-4b6fd03f-702e-4021-a90e-0872635769b4 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4baa19f5-cde9-4958-b945-93a30a85f8f1 req-4b6fd03f-702e-4021-a90e-0872635769b4 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4baa19f5-cde9-4958-b945-93a30a85f8f1 req-4b6fd03f-702e-4021-a90e-0872635769b4 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-4baa19f5-cde9-4958-b945-93a30a85f8f1 req-4b6fd03f-702e-4021-a90e-0872635769b4 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-unplugged-4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-4baa19f5-cde9-4958-b945-93a30a85f8f1 req-4b6fd03f-702e-4021-a90e-0872635769b4 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-4c9e16ea-3c98-4988-8101-527a7cd92765 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.objects.instance [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lazy-loading 'flavor' on Instance uuid 1f24f442-1547-4f20-ba7c-f7790dcc37af {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:07 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Instance destroyed successfully.
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.objects.instance [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lazy-loading 'resources' on Instance uuid 7d9eda42-5048-4838-820b-45844f8e59b0 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:45:34,bridge_name='br-int',has_traffic_filtering=True,id=6ca76c67-3d07-45f3-b07f-5c997c4392d4,network=Network(23fcee45-779d-4b5f-9599-1a91c0f3f58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca76c67-3d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:45:34,bridge_name='br-int',has_traffic_filtering=True,id=6ca76c67-3d07-45f3-b07f-5c997c4392d4,network=Network(23fcee45-779d-4b5f-9599-1a91c0f3f58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca76c67-3d') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ca76c67-3d, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8c2552-a6cd-4b9c-b962-58edaf40dfda tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.968s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29201c3f-c0af-4a2f-92fb-e5bb5211aebf) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: INFO os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:45:34,bridge_name='br-int',has_traffic_filtering=True,id=6ca76c67-3d07-45f3-b07f-5c997c4392d4,network=Network(23fcee45-779d-4b5f-9599-1a91c0f3f58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca76c67-3d')
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:55:34,bridge_name='br-int',has_traffic_filtering=True,id=f0a2b257-cbd8-45df-8fa6-b25c8c22d129,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0a2b257-cb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:55:34,bridge_name='br-int',has_traffic_filtering=True,id=f0a2b257-cbd8-45df-8fa6-b25c8c22d129,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0a2b257-cb') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0a2b257-cb, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeb7f374-2754-415d-b1e6-51bf7e647056) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: INFO os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:55:34,bridge_name='br-int',has_traffic_filtering=True,id=f0a2b257-cbd8-45df-8fa6-b25c8c22d129,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0a2b257-cb')
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:a4:73,bridge_name='br-int',has_traffic_filtering=True,id=b82bff6e-beb2-4812-9927-0e5ba4fc1101,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb82bff6e-be') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:a4:73,bridge_name='br-int',has_traffic_filtering=True,id=b82bff6e-beb2-4812-9927-0e5ba4fc1101,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb82bff6e-be') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb82bff6e-be, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=395790db-5e2d-4684-892c-1f9e547b8b1d) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: INFO os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:a4:73,bridge_name='br-int',has_traffic_filtering=True,id=b82bff6e-beb2-4812-9927-0e5ba4fc1101,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb82bff6e-be')
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:a5,bridge_name='br-int',has_traffic_filtering=True,id=409075c5-56a9-4921-b141-1e30e8cebc9f,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409075c5-56') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:a5,bridge_name='br-int',has_traffic_filtering=True,id=409075c5-56a9-4921-b141-1e30e8cebc9f,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409075c5-56') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap409075c5-56, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5806d0b4-2be9-4e09-b3ae-0b668ebc5152) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: INFO os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:a5,bridge_name='br-int',has_traffic_filtering=True,id=409075c5-56a9-4921-b141-1e30e8cebc9f,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409075c5-56')
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ac:b3,bridge_name='br-int',has_traffic_filtering=True,id=4b2e49ca-5b36-4020-82b5-6e755b1795fd,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2e49ca-5b') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ac:b3,bridge_name='br-int',has_traffic_filtering=True,id=4b2e49ca-5b36-4020-82b5-6e755b1795fd,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2e49ca-5b') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b2e49ca-5b, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28925b43-960a-49fb-b894-5753909d34b2) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: INFO os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ac:b3,bridge_name='br-int',has_traffic_filtering=True,id=4b2e49ca-5b36-4020-82b5-6e755b1795fd,network=Network(49adc057-4c8e-4cc1-a00e-e73cddf09214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b2e49ca-5b')
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:31,bridge_name='br-int',has_traffic_filtering=True,id=c3895efd-2875-45b4-a318-ac6b9d2149c2,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3895efd-28') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:31,bridge_name='br-int',has_traffic_filtering=True,id=c3895efd-2875-45b4-a318-ac6b9d2149c2,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3895efd-28') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3895efd-28, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=259cddb1-0666-4396-bc1c-9cd108550de8) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: INFO os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:31,bridge_name='br-int',has_traffic_filtering=True,id=c3895efd-2875-45b4-a318-ac6b9d2149c2,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3895efd-28')
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-620967480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-620967480',id=9,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi43JD4ttnD1xdRAE1XkTXMCCz21Bls2Ye/RNQp80QWtfguI5lewzSDL2+XMUwkhfLg5frjSF+/+rWYSrXQjvGGw7Cp/7x4VgZNiVbD+zDrPMMMNXz0dxCyr1FYilPRbA==',key_name='tempest-keypair-163313444',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67951a7beaa640758b17efd600d5a65c',ramdisk_id='',reservation_id='r-207lyuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192411437',owner_user_name='tempest-TaggedBootDevicesTest_v242-192411437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36bc4083ea9e4f198fc96919c15b0336',uuid=7d9eda42-5048-4838-820b-45844f8e59b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converting VIF {"id": "4c9e16ea-3c98-4988-8101-527a7cd92765", "address": "fa:16:3e:d6:54:c6", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9e16ea-3c", "ovs_interfaceid": "4c9e16ea-3c98-4988-8101-527a7cd92765", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=4c9e16ea-3c98-4988-8101-527a7cd92765,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9e16ea-3c') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=4c9e16ea-3c98-4988-8101-527a7cd92765,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9e16ea-3c') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c9e16ea-3c, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eab2e28f-645f-4d6b-92e4-d06414b367f6) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:07 user nova-compute[75205]: INFO os_vif [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=4c9e16ea-3c98-4988-8101-527a7cd92765,network=Network(1d0e16c1-eda3-428d-9464-44da1e1c6c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9e16ea-3c')
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwXMcKyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:07 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bc3364-a9c2-430b-bb53-80ccc01c1fea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:11:07 user nova-compute[75205]: No targets found.
Nov 14 19:11:07 user nova-compute[75205]: iSNS:
Nov 14 19:11:07 user nova-compute[75205]: No targets found.
Nov 14 19:11:07 user nova-compute[75205]: STATIC:
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: FIRMWARE:
Nov 14 19:11:07 user nova-compute[75205]: No targets found.
Nov 14 19:11:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:11:07 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:11:07 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2126f108-0f60-4958-b267-0cb34222ba1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[37682395-2f61-4fc3-898d-241753a54a5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:07 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb94bde290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:07 user nova-compute[75205]: WARNING nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-6ca76c67-3d07-45f3-b07f-5c997c4392d4 for instance with vm_state active and task_state deleting.
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-unplugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:07 user nova-compute[75205]: WARNING nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-f0a2b257-cbd8-45df-8fa6-b25c8c22d129 for instance with vm_state active and task_state deleting.
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-unplugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:07 user nova-compute[75205]: WARNING nova.compute.manager [req-628eaa9f-7a0b-4f14-bd2e-b4dda06067d5 req-9cc77281-6369-4c7c-a789-b79d4b6c06a8 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-4b2e49ca-5b36-4020-82b5-6e755b1795fd for instance with vm_state active and task_state deleting.
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[83241c8f-127c-4a08-87cf-51ca84c17f09]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d669df3-77cc-466d-a0a3-a0dfa380dd18]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e204c8a3-4c55-44f4-b98c-5b36e4b332c8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a248b7f3-7d0f-428b-a35d-165eb6d1f910]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d8ecca-5181-40fc-89f0-7063c04d6495]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fbab0d-6463-47d0-835a-885030e18c4e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979, portal: 172.16.0.220,3260]
Nov 14 19:11:07 user nova-compute[75205]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979, portal: 172.16.0.220,3260] successful.
Nov 14 19:11:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a062f787-b1d4-4d3a-81e8-1de96f792979 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7939df-3dfb-4ae3-a956-5ad716091744]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] <== disconnect_volume: return (317ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBkyxsJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:07 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17f2fb7-02f1-42c8-910d-ab57043275bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:11:07 user nova-compute[75205]: No targets found.
Nov 14 19:11:07 user nova-compute[75205]: iSNS:
Nov 14 19:11:07 user nova-compute[75205]: No targets found.
Nov 14 19:11:07 user nova-compute[75205]: STATIC:
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf
Nov 14 19:11:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:07 user nova-compute[75205]: FIRMWARE:
Nov 14 19:11:07 user nova-compute[75205]: No targets found.
Nov 14 19:11:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:11:07 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:11:07 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c384e2c0-dd53-46de-bd1f-644ce36a0c78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5206bc7a-64ad-4ca4-ae23-fb802e389ffc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb742f2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb'): ({'sdd'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Removing single pathed devices sdd {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7648a6c5-2787-4c62-a5f4-0b342e23d01a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb52e9f-a0e7-44a8-8c29-07f9c4980e22]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Flushing IO for device /dev/sdd {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0677b8b6-d581-46de-9e25-a61a36c983d2]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[858fa650-6866-45fa-83b9-e372c97c7b86]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[944c8da8-ba9f-4122-b885-c81fd60169cb]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[381a54df-ad19-40db-953f-2fc49f12f90f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb, portal: 172.16.0.220,3260]
Nov 14 19:11:08 user nova-compute[75205]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb, portal: 172.16.0.220,3260] successful.
Nov 14 19:11:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:08 user nova-compute[75205]: WARNING nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-b82bff6e-beb2-4812-9927-0e5ba4fc1101 for instance with vm_state active and task_state deleting.
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-unplugged-409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-409075c5-56a9-4921-b141-1e30e8cebc9f for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:08 user nova-compute[75205]: WARNING nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-409075c5-56a9-4921-b141-1e30e8cebc9f for instance with vm_state active and task_state deleting.
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-unplugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-unplugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:08 user nova-compute[75205]: WARNING nova.compute.manager [req-b58639b0-86db-4d9f-b60f-35ec5e9a6da8 req-84f7c072-38d3-4db6-b9b6-ddb1a933622d service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-c3895efd-2875-45b4-a318-ac6b9d2149c2 for instance with vm_state active and task_state deleting.
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89ceeb7-7a7f-49cb-9879-bff27a3bf0bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac48c16a-4e0b-4f8e-b258-a19a85cac4d8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] <== disconnect_volume: return (298ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRXiOIca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:08 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9881ddf-d156-45af-bcf1-887e6df94608]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:11:08 user nova-compute[75205]: No targets found.
Nov 14 19:11:08 user nova-compute[75205]: iSNS:
Nov 14 19:11:08 user nova-compute[75205]: No targets found.
Nov 14 19:11:08 user nova-compute[75205]: STATIC:
Nov 14 19:11:08 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6
Nov 14 19:11:08 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:08 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:08 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:11:08 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:08 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:08 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35
Nov 14 19:11:08 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:08 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:08 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:11:08 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:08 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:08 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf
Nov 14 19:11:08 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:08 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:08 user nova-compute[75205]: FIRMWARE:
Nov 14 19:11:08 user nova-compute[75205]: No targets found.
Nov 14 19:11:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:11:08 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:11:08 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[01648891-0148-46db-9c0b-87e5566d48aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a538f49-7c25-4b2a-8898-9cd41e590f8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb94bdd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6'): ({'sde'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Removing single pathed devices sde {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f371319-a0a3-48f0-8298-1c82ce3f2c00]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6966cb-2e32-4c4e-8d40-74f1eb04ed4e]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Flushing IO for device /dev/sde {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b87f79-bd35-4e3f-b389-788379748cd5]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cd1543-9370-4e68-950d-b1054bff85bc]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a31c1f-ab37-409e-83db-78f96ef72f7f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e39c68c-fc08-4666-849d-66b1d168efa3]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6, portal: 172.16.0.220,3260]
Nov 14 19:11:08 user nova-compute[75205]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6, portal: 172.16.0.220,3260] successful.
Nov 14 19:11:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c21ab44-d890-463a-bf92-4245f30259b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17e7607-ae2d-4d9d-929c-e419eee8898a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] <== disconnect_volume: return (294ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:11:08 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Deleting instance files /opt/stack/data/nova/instances/7d9eda42-5048-4838-820b-45844f8e59b0_del
Nov 14 19:11:08 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Deletion of /opt/stack/data/nova/instances/7d9eda42-5048-4838-820b-45844f8e59b0_del complete
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-a19458de-0bac-4a23-bd6b-b6698888919f req-43ff12bf-70c0-4a61-8e06-c6bfa6f8b044 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-plugged-4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a19458de-0bac-4a23-bd6b-b6698888919f req-43ff12bf-70c0-4a61-8e06-c6bfa6f8b044 service nova] Acquiring lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a19458de-0bac-4a23-bd6b-b6698888919f req-43ff12bf-70c0-4a61-8e06-c6bfa6f8b044 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a19458de-0bac-4a23-bd6b-b6698888919f req-43ff12bf-70c0-4a61-8e06-c6bfa6f8b044 service nova] Lock "7d9eda42-5048-4838-820b-45844f8e59b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-a19458de-0bac-4a23-bd6b-b6698888919f req-43ff12bf-70c0-4a61-8e06-c6bfa6f8b044 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] No waiting events found dispatching network-vif-plugged-4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:08 user nova-compute[75205]: WARNING nova.compute.manager [req-a19458de-0bac-4a23-bd6b-b6698888919f req-43ff12bf-70c0-4a61-8e06-c6bfa6f8b044 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received unexpected event network-vif-plugged-4c9e16ea-3c98-4988-8101-527a7cd92765 for instance with vm_state active and task_state deleting.
Nov 14 19:11:08 user nova-compute[75205]: INFO nova.compute.manager [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Took 3.40 seconds to destroy the instance on the hypervisor.
Nov 14 19:11:08 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:11:08 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:11:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Creating image(s)
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Ensure instance console log exists: /opt/stack/data/nova/instances/622d19bf-0618-49a9-9f71-b632d9e11301/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Start _get_guest_xml network_info=[{"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epHdMIaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '622d19bf-0618-49a9-9f71-b632d9e11301', 'attached_at': '', 'detached_at': '', 'volume_id': '77e65258-d6ca-4db1-8633-f8f45aa20d76', 'serial': '77e65258-d6ca-4db1-8633-f8f45aa20d76'}, 'attachment_id': '611522ef-4027-437c-803e-be6c54f56374', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:11:09 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 19:11:09 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:11:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lazy-loading 'vcpu_model' on Instance uuid 622d19bf-0618-49a9-9f71-b632d9e11301 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epHdMIaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:10 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:10 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:10 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f0fec7-4766-4645-90d2-599534ec6119]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:11:10 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd371b-545a-4505-9a6b-f1063a2b7448]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76] added
Nov 14 19:11:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b454c2-5820-4033-a41a-144ff2c39a16]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c4c162-4a97-460b-9e13-4e15e6d52c5d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epHdMIaN {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epHdMIaN" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b935614a-0a44-41fb-a9dc-d411bf494241]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'epHdMIaN'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[914440ba-40c2-4794-8f87-a278f621ecb0]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d54c5c-0138-4bae-8e06-9dce7042745c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-12ec0d42-a2c7-4b86-bc51-4cddaca4e9ff req-b4044364-96e7-4da4-abaa-75ef4ac54621 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-deleted-4c9e16ea-3c98-4988-8101-527a7cd92765 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:10 user nova-compute[75205]: INFO nova.compute.manager [req-12ec0d42-a2c7-4b86-bc51-4cddaca4e9ff req-b4044364-96e7-4da4-abaa-75ef4ac54621 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Neutron deleted interface 4c9e16ea-3c98-4988-8101-527a7cd92765; detaching it from the instance and deleting it from the info cache
Nov 14 19:11:10 user nova-compute[75205]: DEBUG nova.network.neutron [req-12ec0d42-a2c7-4b86-bc51-4cddaca4e9ff req-b4044364-96e7-4da4-abaa-75ef4ac54621 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [{"id": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "address": "fa:16:3e:04:45:34", "network": {"id": "23fcee45-779d-4b5f-9599-1a91c0f3f58c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-202818313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca76c67-3d", "ovs_interfaceid": "6ca76c67-3d07-45f3-b07f-5c997c4392d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "address": "fa:16:3e:a2:55:34", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2b257-cb", "ovs_interfaceid": "f0a2b257-cbd8-45df-8fa6-b25c8c22d129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "address": "fa:16:3e:aa:a4:73", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb82bff6e-be", "ovs_interfaceid": "b82bff6e-beb2-4812-9927-0e5ba4fc1101", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "409075c5-56a9-4921-b141-1e30e8cebc9f", "address": "fa:16:3e:69:03:a5", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409075c5-56", "ovs_interfaceid": "409075c5-56a9-4921-b141-1e30e8cebc9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "address": "fa:16:3e:ba:ac:b3", "network": {"id": "49adc057-4c8e-4cc1-a00e-e73cddf09214", "bridge": "br-int", "label": "tempest-device-tagging-net1-655265794", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e49ca-5b", "ovs_interfaceid": "4b2e49ca-5b36-4020-82b5-6e755b1795fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "address": "fa:16:3e:d6:6e:31", "network": {"id": "1d0e16c1-eda3-428d-9464-44da1e1c6c8b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1812693219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67951a7beaa640758b17efd600d5a65c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3895efd-28", "ovs_interfaceid": "c3895efd-2875-45b4-a318-ac6b9d2149c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0100d3a6-c9e8-4d6f-9a06-3fbc8d700662]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260]
Nov 14 19:11:10 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260] successful.
Nov 14 19:11:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-12ec0d42-a2c7-4b86-bc51-4cddaca4e9ff req-b4044364-96e7-4da4-abaa-75ef4ac54621 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Detach interface failed, port_id=4c9e16ea-3c98-4988-8101-527a7cd92765, reason: Instance 7d9eda42-5048-4838-820b-45844f8e59b0 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42a1d60-9eb2-4d63-b57c-c3ceb32f5261]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a21469b-18f1-4d50-a63d-88dc9d4fcda0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fa43c3-c323-46ea-ba78-bc0d7469f311]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:11:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epHdMIaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23630623530336561', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630623530336561', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-502671428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-266304409',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuroo777PzrJhNT1Z+8Bz3bmZfqCc+/PXCXIZcuctFMhrY1Rpfi1QfSM9QpIJtELl/C4MHfcfyzeOJ7oaOGYkNsgfsiChX3EizTbvsbrCm3XCIgNnKEPubgbl6oglzwDw==',key_name='tempest-keypair-1647726640',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3325c3ab571b451da9cffb93069482f5',ramdisk_id='',reservation_id='r-7uy2l8c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-667072902',owner_user_name='tempest-ServerActionsV293TestJSON-667072902-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11e8a4105e694b14b530792142351388',uuid=622d19bf-0618-49a9-9f71-b632d9e11301,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converting VIF {"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:11:11 user nova-compute[75205]:   <uuid>622d19bf-0618-49a9-9f71-b632d9e11301</uuid>
Nov 14 19:11:11 user nova-compute[75205]:   <name>instance-00000008</name>
Nov 14 19:11:11 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:11:11 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:11:11 user nova-compute[75205]:   <metadata>
Nov 14 19:11:11 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:11:11 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:11:11 user nova-compute[75205]:       <nova:name>tempest-ServerActionsV293TestJSON-server-502671428</nova:name>
Nov 14 19:11:11 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:11:09</nova:creationTime>
Nov 14 19:11:11 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:11:11 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:11:11 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:11:11 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:11:11 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:11:11 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:11:11 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:11:11 user nova-compute[75205]:       <nova:owner>
Nov 14 19:11:11 user nova-compute[75205]:         <nova:user uuid="11e8a4105e694b14b530792142351388">tempest-ServerActionsV293TestJSON-667072902-project-member</nova:user>
Nov 14 19:11:11 user nova-compute[75205]:         <nova:project uuid="3325c3ab571b451da9cffb93069482f5">tempest-ServerActionsV293TestJSON-667072902</nova:project>
Nov 14 19:11:11 user nova-compute[75205]:       </nova:owner>
Nov 14 19:11:11 user nova-compute[75205]:       <nova:ports>
Nov 14 19:11:11 user nova-compute[75205]:         <nova:port uuid="7fc6ede6-60c6-4440-a719-9397a8437fbb">
Nov 14 19:11:11 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:11:11 user nova-compute[75205]:         </nova:port>
Nov 14 19:11:11 user nova-compute[75205]:       </nova:ports>
Nov 14 19:11:11 user nova-compute[75205]:     </nova:instance>
Nov 14 19:11:11 user nova-compute[75205]:   </metadata>
Nov 14 19:11:11 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:11:11 user nova-compute[75205]:     <system>
Nov 14 19:11:11 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:11:11 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:11:11 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:11:11 user nova-compute[75205]:       <entry name="serial">622d19bf-0618-49a9-9f71-b632d9e11301</entry>
Nov 14 19:11:11 user nova-compute[75205]:       <entry name="uuid">622d19bf-0618-49a9-9f71-b632d9e11301</entry>
Nov 14 19:11:11 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:11:11 user nova-compute[75205]:     </system>
Nov 14 19:11:11 user nova-compute[75205]:   </sysinfo>
Nov 14 19:11:11 user nova-compute[75205]:   <os>
Nov 14 19:11:11 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:11:11 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:11:11 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:11:11 user nova-compute[75205]:   </os>
Nov 14 19:11:11 user nova-compute[75205]:   <features>
Nov 14 19:11:11 user nova-compute[75205]:     <acpi/>
Nov 14 19:11:11 user nova-compute[75205]:     <apic/>
Nov 14 19:11:11 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:11:11 user nova-compute[75205]:   </features>
Nov 14 19:11:11 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:11:11 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:11:11 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:11:11 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:11:11 user nova-compute[75205]:   </clock>
Nov 14 19:11:11 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:11:11 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:11:11 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:11:11 user nova-compute[75205]:   </cpu>
Nov 14 19:11:11 user nova-compute[75205]:   <devices>
Nov 14 19:11:11 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:11:11 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:11:11 user nova-compute[75205]:       <source dev="/dev/sdc"/>
Nov 14 19:11:11 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:11:11 user nova-compute[75205]:       <serial>77e65258-d6ca-4db1-8633-f8f45aa20d76</serial>
Nov 14 19:11:11 user nova-compute[75205]:     </disk>
Nov 14 19:11:11 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:11:11 user nova-compute[75205]:       <mac address="fa:16:3e:2f:65:53"/>
Nov 14 19:11:11 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:11:11 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:11:11 user nova-compute[75205]:       <target dev="tap7fc6ede6-60"/>
Nov 14 19:11:11 user nova-compute[75205]:     </interface>
Nov 14 19:11:11 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:11:11 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/622d19bf-0618-49a9-9f71-b632d9e11301/console.log" append="off"/>
Nov 14 19:11:11 user nova-compute[75205]:     </serial>
Nov 14 19:11:11 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:11:11 user nova-compute[75205]:     <video>
Nov 14 19:11:11 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:11:11 user nova-compute[75205]:     </video>
Nov 14 19:11:11 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:11:11 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:11:11 user nova-compute[75205]:     </rng>
Nov 14 19:11:11 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:11:11 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:11:11 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:11:11 user nova-compute[75205]:     </memballoon>
Nov 14 19:11:11 user nova-compute[75205]:   </devices>
Nov 14 19:11:11 user nova-compute[75205]: </domain>
Nov 14 19:11:11 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-502671428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-266304409',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuroo777PzrJhNT1Z+8Bz3bmZfqCc+/PXCXIZcuctFMhrY1Rpfi1QfSM9QpIJtELl/C4MHfcfyzeOJ7oaOGYkNsgfsiChX3EizTbvsbrCm3XCIgNnKEPubgbl6oglzwDw==',key_name='tempest-keypair-1647726640',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3325c3ab571b451da9cffb93069482f5',ramdisk_id='',reservation_id='r-7uy2l8c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-667072902',owner_user_name='tempest-ServerActionsV293TestJSON-667072902-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11e8a4105e694b14b530792142351388',uuid=622d19bf-0618-49a9-9f71-b632d9e11301,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converting VIF {"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_vif [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac377cf3-eecc-5d42-9f72-cee3387d32c2', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fc6ede6-60, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fc6ede6-60, col_values=(('qos', UUID('b9275a45-afa1-4b67-8706-a8e9941c8831')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fc6ede6-60, col_values=(('external_ids', {'iface-id': '7fc6ede6-60c6-4440-a719-9397a8437fbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:65:53', 'vm-uuid': '622d19bf-0618-49a9-9f71-b632d9e11301'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:11 user nova-compute[75205]: INFO os_vif [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60')
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] No VIF found with MAC fa:16:3e:2f:65:53, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:11 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2696233-b1c2-466d-92f1-0a30c3db1501 is timed out.
Nov 14 19:11:11 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Successfully detached device vdb from instance b2696233-b1c2-466d-92f1-0a30c3db1501 from the live domain config.
Nov 14 19:11:11 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Took 3.02 seconds to deallocate network for instance.
Nov 14 19:11:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ULqDQyJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:11 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[875320c6-1762-4feb-9889-327a8b7313d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:11:11 user nova-compute[75205]: No targets found.
Nov 14 19:11:11 user nova-compute[75205]: iSNS:
Nov 14 19:11:11 user nova-compute[75205]: No targets found.
Nov 14 19:11:11 user nova-compute[75205]: STATIC:
Nov 14 19:11:11 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:11:11 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:11 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:11 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76
Nov 14 19:11:11 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:11 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:11 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35
Nov 14 19:11:11 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:11 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:11 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:11:11 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:11 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:11 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf
Nov 14 19:11:11 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:11 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:11 user nova-compute[75205]: FIRMWARE:
Nov 14 19:11:11 user nova-compute[75205]: No targets found.
Nov 14 19:11:11 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:11:11 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:11:11 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c3bf88-5d1b-4081-8abf-bf5fc6177ec9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[85716a81-f424-45ad-9ee6-71a59d6400dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:11 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:11 user nova-compute[75205]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:11 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:11 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:11 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 (non-flash)
Nov 14 19:11:11 user nova-compute[75205]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:11 user nova-compute[75205]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:11 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:11 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:11 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c27b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35'): ({'sdi'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Removing single pathed devices sdi {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f6c888-e5c0-4f5a-8965-0f20c959286c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9da448-12de-4a15-bbe7-472fb4aa7761]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Flushing IO for device /dev/sdi {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a62404c-bf3e-4bf4-ad6b-1e41e4661607]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.050s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[81976d93-f7ea-4c65-a465-a4e5a3cd3ffd]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] SCSI volumes sdi have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:11:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff946c84-13f7-4d95-b04d-455274bab4fa]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4e57a1-1ddf-4218-958e-83de56294983]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35, portal: 172.16.0.220,3260]
Nov 14 19:11:12 user nova-compute[75205]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35, portal: 172.16.0.220,3260] successful.
Nov 14 19:11:12 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335ac66e-f430-4fb6-b61b-870da985af35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6064dc4d-dbcc-401a-a538-77fca7393308]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] <== disconnect_volume: return (355ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-0f0030ff-7486-45af-872f-b7647b21c131 req-ce8ec426-e80a-40bf-9e71-24272c2928c0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-deleted-409075c5-56a9-4921-b141-1e30e8cebc9f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-0f0030ff-7486-45af-872f-b7647b21c131 req-ce8ec426-e80a-40bf-9e71-24272c2928c0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-deleted-6ca76c67-3d07-45f3-b07f-5c997c4392d4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-0f0030ff-7486-45af-872f-b7647b21c131 req-ce8ec426-e80a-40bf-9e71-24272c2928c0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-deleted-4b2e49ca-5b36-4020-82b5-6e755b1795fd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-0f0030ff-7486-45af-872f-b7647b21c131 req-ce8ec426-e80a-40bf-9e71-24272c2928c0 service nova] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Received event network-vif-deleted-c3895efd-2875-45b4-a318-ac6b9d2149c2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lazy-loading 'flavor' on Instance uuid b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cc8714de-2c8f-486e-945a-6dad98c50b99 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.864s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "interface-b2696233-b1c2-466d-92f1-0a30c3db1501-8abdb7de-37af-4d8f-986b-a37a25d32001" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "interface-b2696233-b1c2-466d-92f1-0a30c3db1501-8abdb7de-37af-4d8f-986b-a37a25d32001" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lazy-loading 'flavor' on Instance uuid b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923454376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923454376',id=6,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkRIwsBeDyQ11FuXQIwqoygHpHsgf3Cdt8fX3locV211FBgH9EBzW/BZRFfpB5sEUt5eCT8S2LhivMEVz8NcFsdFBPYZakdFldF/6rJgd/n1gME/tmQkgZpjcxprOgRtg==',key_name='tempest-keypair-1747689188',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11eaa2f5d6a94a368051677cc0d85b33',ramdisk_id='',reservation_id='r-nrqchh9b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-551564993',owner_user_name='tempest-TaggedAttachmentsTest-551564993-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65487f5c81204b0d86821d4a0eec289c',uuid=b2696233-b1c2-466d-92f1-0a30c3db1501,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converting VIF {"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b9:c0:58"/><model type="virtio"/><mtu size="1442"/><target dev="tap8abdb7de-37"/></interface> {{(pid=75205) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b9:c0:58"/><model type="virtio"/><mtu size="1442"/><target dev="tap8abdb7de-37"/></interface> {{(pid=75205) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Attempting to detach device tap8abdb7de-37 from instance b2696233-b1c2-466d-92f1-0a30c3db1501 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] detach device xml: <interface type="ethernet">
Nov 14 19:11:13 user nova-compute[75205]:   <mac address="fa:16:3e:b9:c0:58"/>
Nov 14 19:11:13 user nova-compute[75205]:   <model type="virtio"/>
Nov 14 19:11:13 user nova-compute[75205]:   <mtu size="1442"/>
Nov 14 19:11:13 user nova-compute[75205]:   <target dev="tap8abdb7de-37"/>
Nov 14 19:11:13 user nova-compute[75205]: </interface>
Nov 14 19:11:13 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b9:c0:58"/><model type="virtio"/><mtu size="1442"/><target dev="tap8abdb7de-37"/></interface> {{(pid=75205) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b9:c0:58"/><model type="virtio"/><mtu size="1442"/><target dev="tap8abdb7de-37"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 14 19:11:13 user nova-compute[75205]:   <name>instance-00000006</name>
Nov 14 19:11:13 user nova-compute[75205]:   <uuid>b2696233-b1c2-466d-92f1-0a30c3db1501</uuid>
Nov 14 19:11:13 user nova-compute[75205]:   <metadata>
Nov 14 19:11:13 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:11:13 user nova-compute[75205]:   <nova:package version="0.0.0"/>
Nov 14 19:11:13 user nova-compute[75205]:   <nova:name>tempest-device-tagging-server-923454376</nova:name>
Nov 14 19:11:13 user nova-compute[75205]:   <nova:creationTime>2023-11-14 19:10:42</nova:creationTime>
Nov 14 19:11:13 user nova-compute[75205]:   <nova:flavor name="m1.tiny">
Nov 14 19:11:13 user nova-compute[75205]:     <nova:memory>512</nova:memory>
Nov 14 19:11:13 user nova-compute[75205]:     <nova:disk>1</nova:disk>
Nov 14 19:11:13 user nova-compute[75205]:     <nova:swap>0</nova:swap>
Nov 14 19:11:13 user nova-compute[75205]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:11:13 user nova-compute[75205]:     <nova:vcpus>1</nova:vcpus>
Nov 14 19:11:13 user nova-compute[75205]:   </nova:flavor>
Nov 14 19:11:13 user nova-compute[75205]:   <nova:owner>
Nov 14 19:11:13 user nova-compute[75205]:     <nova:user uuid="65487f5c81204b0d86821d4a0eec289c">tempest-TaggedAttachmentsTest-551564993-project-member</nova:user>
Nov 14 19:11:13 user nova-compute[75205]:     <nova:project uuid="11eaa2f5d6a94a368051677cc0d85b33">tempest-TaggedAttachmentsTest-551564993</nova:project>
Nov 14 19:11:13 user nova-compute[75205]:   </nova:owner>
Nov 14 19:11:13 user nova-compute[75205]:   <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:11:13 user nova-compute[75205]:   <nova:ports>
Nov 14 19:11:13 user nova-compute[75205]:     <nova:port uuid="56984858-000b-45d7-a6f0-13dc113e14f6">
Nov 14 19:11:13 user nova-compute[75205]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:11:13 user nova-compute[75205]:     </nova:port>
Nov 14 19:11:13 user nova-compute[75205]:     <nova:port uuid="8abdb7de-37af-4d8f-986b-a37a25d32001">
Nov 14 19:11:13 user nova-compute[75205]:       <nova:ip type="fixed" address="10.10.10.188" ipVersion="4"/>
Nov 14 19:11:13 user nova-compute[75205]:     </nova:port>
Nov 14 19:11:13 user nova-compute[75205]:   </nova:ports>
Nov 14 19:11:13 user nova-compute[75205]: </nova:instance>
Nov 14 19:11:13 user nova-compute[75205]:   </metadata>
Nov 14 19:11:13 user nova-compute[75205]:   <memory unit='KiB'>524288</memory>
Nov 14 19:11:13 user nova-compute[75205]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 19:11:13 user nova-compute[75205]:   <vcpu placement='static'>1</vcpu>
Nov 14 19:11:13 user nova-compute[75205]:   <resource>
Nov 14 19:11:13 user nova-compute[75205]:     <partition>/machine</partition>
Nov 14 19:11:13 user nova-compute[75205]:   </resource>
Nov 14 19:11:13 user nova-compute[75205]:   <sysinfo type='smbios'>
Nov 14 19:11:13 user nova-compute[75205]:     <system>
Nov 14 19:11:13 user nova-compute[75205]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 19:11:13 user nova-compute[75205]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 19:11:13 user nova-compute[75205]:       <entry name='version'>0.0.0</entry>
Nov 14 19:11:13 user nova-compute[75205]:       <entry name='serial'>b2696233-b1c2-466d-92f1-0a30c3db1501</entry>
Nov 14 19:11:13 user nova-compute[75205]:       <entry name='uuid'>b2696233-b1c2-466d-92f1-0a30c3db1501</entry>
Nov 14 19:11:13 user nova-compute[75205]:       <entry name='family'>Virtual Machine</entry>
Nov 14 19:11:13 user nova-compute[75205]:     </system>
Nov 14 19:11:13 user nova-compute[75205]:   </sysinfo>
Nov 14 19:11:13 user nova-compute[75205]:   <os>
Nov 14 19:11:13 user nova-compute[75205]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 19:11:13 user nova-compute[75205]:     <boot dev='hd'/>
Nov 14 19:11:13 user nova-compute[75205]:     <smbios mode='sysinfo'/>
Nov 14 19:11:13 user nova-compute[75205]:   </os>
Nov 14 19:11:13 user nova-compute[75205]:   <features>
Nov 14 19:11:13 user nova-compute[75205]:     <acpi/>
Nov 14 19:11:13 user nova-compute[75205]:     <apic/>
Nov 14 19:11:13 user nova-compute[75205]:     <vmcoreinfo state='on'/>
Nov 14 19:11:13 user nova-compute[75205]:   </features>
Nov 14 19:11:13 user nova-compute[75205]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 19:11:13 user nova-compute[75205]:     <model fallback='forbid'>Nehalem</model>
Nov 14 19:11:13 user nova-compute[75205]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 19:11:13 user nova-compute[75205]:     <feature policy='require' name='vme'/>
Nov 14 19:11:13 user nova-compute[75205]:     <feature policy='require' name='x2apic'/>
Nov 14 19:11:13 user nova-compute[75205]:     <feature policy='require' name='hypervisor'/>
Nov 14 19:11:13 user nova-compute[75205]:   </cpu>
Nov 14 19:11:13 user nova-compute[75205]:   <clock offset='utc'>
Nov 14 19:11:13 user nova-compute[75205]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 19:11:13 user nova-compute[75205]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 19:11:13 user nova-compute[75205]:     <timer name='hpet' present='no'/>
Nov 14 19:11:13 user nova-compute[75205]:   </clock>
Nov 14 19:11:13 user nova-compute[75205]:   <on_poweroff>destroy</on_poweroff>
Nov 14 19:11:13 user nova-compute[75205]:   <on_reboot>restart</on_reboot>
Nov 14 19:11:13 user nova-compute[75205]:   <on_crash>destroy</on_crash>
Nov 14 19:11:13 user nova-compute[75205]:   <devices>
Nov 14 19:11:13 user nova-compute[75205]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 19:11:13 user nova-compute[75205]:     <disk type='file' device='disk'>
Nov 14 19:11:13 user nova-compute[75205]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 19:11:13 user nova-compute[75205]:       <source file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk' index='2'/>
Nov 14 19:11:13 user nova-compute[75205]:       <backingStore type='file' index='3'>
Nov 14 19:11:13 user nova-compute[75205]:         <format type='raw'/>
Nov 14 19:11:13 user nova-compute[75205]:         <source file='/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de'/>
Nov 14 19:11:13 user nova-compute[75205]:         <backingStore/>
Nov 14 19:11:13 user nova-compute[75205]:       </backingStore>
Nov 14 19:11:13 user nova-compute[75205]:       <target dev='vda' bus='virtio'/>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='virtio-disk0'/>
Nov 14 19:11:13 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </disk>
Nov 14 19:11:13 user nova-compute[75205]:     <disk type='file' device='cdrom'>
Nov 14 19:11:13 user nova-compute[75205]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 19:11:13 user nova-compute[75205]:       <source file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.config' index='1'/>
Nov 14 19:11:13 user nova-compute[75205]:       <backingStore/>
Nov 14 19:11:13 user nova-compute[75205]:       <target dev='hda' bus='ide'/>
Nov 14 19:11:13 user nova-compute[75205]:       <readonly/>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='ide0-0-0'/>
Nov 14 19:11:13 user nova-compute[75205]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </disk>
Nov 14 19:11:13 user nova-compute[75205]:     <controller type='usb' index='0' model='none'>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='usb'/>
Nov 14 19:11:13 user nova-compute[75205]:     </controller>
Nov 14 19:11:13 user nova-compute[75205]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='pci.0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </controller>
Nov 14 19:11:13 user nova-compute[75205]:     <controller type='ide' index='0'>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='ide'/>
Nov 14 19:11:13 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 19:11:13 user nova-compute[75205]:     </controller>
Nov 14 19:11:13 user nova-compute[75205]:     <interface type='ethernet'>
Nov 14 19:11:13 user nova-compute[75205]:       <mac address='fa:16:3e:e0:1f:1e'/>
Nov 14 19:11:13 user nova-compute[75205]:       <target dev='tap56984858-00'/>
Nov 14 19:11:13 user nova-compute[75205]:       <model type='virtio'/>
Nov 14 19:11:13 user nova-compute[75205]:       <mtu size='1442'/>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='net0'/>
Nov 14 19:11:13 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </interface>
Nov 14 19:11:13 user nova-compute[75205]:     <interface type='ethernet'>
Nov 14 19:11:13 user nova-compute[75205]:       <mac address='fa:16:3e:b9:c0:58'/>
Nov 14 19:11:13 user nova-compute[75205]:       <target dev='tap8abdb7de-37'/>
Nov 14 19:11:13 user nova-compute[75205]:       <model type='virtio'/>
Nov 14 19:11:13 user nova-compute[75205]:       <mtu size='1442'/>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='net1'/>
Nov 14 19:11:13 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </interface>
Nov 14 19:11:13 user nova-compute[75205]:     <serial type='pty'>
Nov 14 19:11:13 user nova-compute[75205]:       <source path='/dev/pts/5'/>
Nov 14 19:11:13 user nova-compute[75205]:       <log file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/console.log' append='off'/>
Nov 14 19:11:13 user nova-compute[75205]:       <target type='isa-serial' port='0'>
Nov 14 19:11:13 user nova-compute[75205]:         <model name='isa-serial'/>
Nov 14 19:11:13 user nova-compute[75205]:       </target>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='serial0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </serial>
Nov 14 19:11:13 user nova-compute[75205]:     <console type='pty' tty='/dev/pts/5'>
Nov 14 19:11:13 user nova-compute[75205]:       <source path='/dev/pts/5'/>
Nov 14 19:11:13 user nova-compute[75205]:       <log file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/console.log' append='off'/>
Nov 14 19:11:13 user nova-compute[75205]:       <target type='serial' port='0'/>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='serial0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </console>
Nov 14 19:11:13 user nova-compute[75205]:     <input type='mouse' bus='ps2'>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='input0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </input>
Nov 14 19:11:13 user nova-compute[75205]:     <input type='keyboard' bus='ps2'>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='input1'/>
Nov 14 19:11:13 user nova-compute[75205]:     </input>
Nov 14 19:11:13 user nova-compute[75205]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 14 19:11:13 user nova-compute[75205]:       <listen type='address' address='0.0.0.0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </graphics>
Nov 14 19:11:13 user nova-compute[75205]:     <audio id='1' type='none'/>
Nov 14 19:11:13 user nova-compute[75205]:     <video>
Nov 14 19:11:13 user nova-compute[75205]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='video0'/>
Nov 14 19:11:13 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </video>
Nov 14 19:11:13 user nova-compute[75205]:     <memballoon model='virtio'>
Nov 14 19:11:13 user nova-compute[75205]:       <stats period='10'/>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='balloon0'/>
Nov 14 19:11:13 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </memballoon>
Nov 14 19:11:13 user nova-compute[75205]:     <rng model='virtio'>
Nov 14 19:11:13 user nova-compute[75205]:       <backend model='random'>/dev/urandom</backend>
Nov 14 19:11:13 user nova-compute[75205]:       <alias name='rng0'/>
Nov 14 19:11:13 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 19:11:13 user nova-compute[75205]:     </rng>
Nov 14 19:11:13 user nova-compute[75205]:   </devices>
Nov 14 19:11:13 user nova-compute[75205]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 19:11:13 user nova-compute[75205]:     <label>libvirt-b2696233-b1c2-466d-92f1-0a30c3db1501</label>
Nov 14 19:11:13 user nova-compute[75205]:     <imagelabel>libvirt-b2696233-b1c2-466d-92f1-0a30c3db1501</imagelabel>
Nov 14 19:11:13 user nova-compute[75205]:   </seclabel>
Nov 14 19:11:13 user nova-compute[75205]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 19:11:13 user nova-compute[75205]:     <label>+64055:+108</label>
Nov 14 19:11:13 user nova-compute[75205]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 19:11:13 user nova-compute[75205]:   </seclabel>
Nov 14 19:11:13 user nova-compute[75205]: </domain>
Nov 14 19:11:13 user nova-compute[75205]:  {{(pid=75205) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 19:11:13 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Successfully detached device tap8abdb7de-37 from instance b2696233-b1c2-466d-92f1-0a30c3db1501 from the persistent domain config.
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] (1/8): Attempting to detach device tap8abdb7de-37 with device alias net1 from instance b2696233-b1c2-466d-92f1-0a30c3db1501 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:11:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] detach device xml: <interface type="ethernet">
Nov 14 19:11:13 user nova-compute[75205]:   <mac address="fa:16:3e:b9:c0:58"/>
Nov 14 19:11:13 user nova-compute[75205]:   <model type="virtio"/>
Nov 14 19:11:13 user nova-compute[75205]:   <mtu size="1442"/>
Nov 14 19:11:13 user nova-compute[75205]:   <target dev="tap8abdb7de-37"/>
Nov 14 19:11:13 user nova-compute[75205]: </interface>
Nov 14 19:11:13 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:11:14 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aa9e5564-b68f-42b4-9263-709641bde28b is timed out.
Nov 14 19:11:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Successfully detached device vdb from instance aa9e5564-b68f-42b4-9263-709641bde28b from the live domain config.
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edhnzUYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:14 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cd2b2f-5c30-45dc-9cec-0d7f47a4857a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:11:14 user nova-compute[75205]: No targets found.
Nov 14 19:11:14 user nova-compute[75205]: iSNS:
Nov 14 19:11:14 user nova-compute[75205]: No targets found.
Nov 14 19:11:14 user nova-compute[75205]: STATIC:
Nov 14 19:11:14 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:11:14 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:14 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:14 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76
Nov 14 19:11:14 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:14 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:14 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:11:14 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:14 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:14 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf
Nov 14 19:11:14 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:14 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:14 user nova-compute[75205]: FIRMWARE:
Nov 14 19:11:14 user nova-compute[75205]: No targets found.
Nov 14 19:11:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:11:14 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:11:14 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b2e29e-0d23-4c02-bca6-698c708ad597]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0567861-6b40-4f13-9279-13c2a3f59ddf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:14 user nova-compute[75205]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:14 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:14 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf (non-flash)
Nov 14 19:11:14 user nova-compute[75205]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:14 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:14 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c27bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f66907-08ca-4af4-8c4a-3b387091d04f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d13c5a-96c6-438a-a09d-32c3d13ac197]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:11:14 user nova-compute[75205]: INFO nova.compute.manager [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] [instance: 7d9eda42-5048-4838-820b-45844f8e59b0] Took 2.45 seconds to detach 3 volumes for instance.
Nov 14 19:11:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b63b4f-ff00-4ead-9432-60c7f765f69a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Start waiting for the detach event from libvirt for device tap8abdb7de-37 with device alias net1 for instance b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9b8ecc-2763-4204-ae26-fb1c9d876269]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] No waiting events found dispatching network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:14 user nova-compute[75205]: WARNING nova.compute.manager [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received unexpected event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb for instance with vm_state active and task_state rebuild_spawning.
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] No waiting events found dispatching network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:14 user nova-compute[75205]: WARNING nova.compute.manager [req-2f1241bd-5f17-43c8-92a8-cd77f70fedd5 req-4d977731-cd14-4b00-bd98-6ccac3e8af4b service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received unexpected event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb for instance with vm_state active and task_state rebuild_spawning.
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2404e39-6f15-40fc-be4a-9def2b157683]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce4dda1-61ef-4d7c-b1ee-f9921fb59c57]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf, portal: 172.16.0.220,3260]
Nov 14 19:11:14 user nova-compute[75205]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf, portal: 172.16.0.220,3260] successful.
Nov 14 19:11:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bab1fa-8394-4619-9776-f24839f95caf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea2f720-cb21-4d9d-a14b-9f9dab370d3b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] <== disconnect_volume: return (346ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-9a161d2f-bd9b-440c-909e-bf10d40fde87 req-51c338d6-872a-49ae-bb2b-c9fba36c9178 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-unplugged-8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9a161d2f-bd9b-440c-909e-bf10d40fde87 req-51c338d6-872a-49ae-bb2b-c9fba36c9178 service nova] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9a161d2f-bd9b-440c-909e-bf10d40fde87 req-51c338d6-872a-49ae-bb2b-c9fba36c9178 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9a161d2f-bd9b-440c-909e-bf10d40fde87 req-51c338d6-872a-49ae-bb2b-c9fba36c9178 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-9a161d2f-bd9b-440c-909e-bf10d40fde87 req-51c338d6-872a-49ae-bb2b-c9fba36c9178 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] No waiting events found dispatching network-vif-unplugged-8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:14 user nova-compute[75205]: WARNING nova.compute.manager [req-9a161d2f-bd9b-440c-909e-bf10d40fde87 req-51c338d6-872a-49ae-bb2b-c9fba36c9178 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received unexpected event network-vif-unplugged-8abdb7de-37af-4d8f-986b-a37a25d32001 for instance with vm_state active and task_state None.
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:14 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Deleted allocations for instance 7d9eda42-5048-4838-820b-45844f8e59b0
Nov 14 19:11:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c83d53b6-4bba-4d75-a6f9-07a6783bf760 tempest-TaggedBootDevicesTest_v242-192411437 tempest-TaggedBootDevicesTest_v242-192411437-project-member] Lock "7d9eda42-5048-4838-820b-45844f8e59b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.526s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:11:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Instance spawned successfully.
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:11:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75205) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 19:11:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lazy-loading 'flavor' on Instance uuid aa9e5564-b68f-42b4-9263-709641bde28b {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7ffb2651-706e-48d4-a63d-99730d3b0e73 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3196bbb8-39f1-4bee-9b8e-9736ce70c040 tempest-VolumesAssistedSnapshotsTest-1778131471 tempest-VolumesAssistedSnapshotsTest-1778131471-project-admin] Lock "aa9e5564-b68f-42b4-9263-709641bde28b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.845s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-a46e7362-b6b3-4a34-952d-6d57b0ff8fb8 req-b2b843d7-a17f-4323-8c7b-5a12bd92fc02 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-plugged-8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a46e7362-b6b3-4a34-952d-6d57b0ff8fb8 req-b2b843d7-a17f-4323-8c7b-5a12bd92fc02 service nova] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a46e7362-b6b3-4a34-952d-6d57b0ff8fb8 req-b2b843d7-a17f-4323-8c7b-5a12bd92fc02 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a46e7362-b6b3-4a34-952d-6d57b0ff8fb8 req-b2b843d7-a17f-4323-8c7b-5a12bd92fc02 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-a46e7362-b6b3-4a34-952d-6d57b0ff8fb8 req-b2b843d7-a17f-4323-8c7b-5a12bd92fc02 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] No waiting events found dispatching network-vif-plugged-8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:16 user nova-compute[75205]: WARNING nova.compute.manager [req-a46e7362-b6b3-4a34-952d-6d57b0ff8fb8 req-b2b843d7-a17f-4323-8c7b-5a12bd92fc02 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received unexpected event network-vif-plugged-8abdb7de-37af-4d8f-986b-a37a25d32001 for instance with vm_state active and task_state None.
Nov 14 19:11:19 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "d453ca1b-600f-40a9-9478-60ae619302ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:19 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:11:19 user nova-compute[75205]: INFO nova.compute.claims [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Claim successful on node user
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updating instance_info_cache with network_info: [{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:11:20 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:11:20 user nova-compute[75205]: INFO nova.virt.block_device [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Booting with blank volume at /dev/vda
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG nova.policy [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0ee9d2093e64175b45b3b4d99b5648f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde587867310451cab4f464b330555af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Successfully created port: 5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Successfully updated port: 5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquired lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-450ee95b-7f9e-43f4-a03c-0070aed79c1b req-54a0404e-1975-4343-b4d4-325655fbf02e service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-changed-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-450ee95b-7f9e-43f4-a03c-0070aed79c1b req-54a0404e-1975-4343-b4d4-325655fbf02e service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Refreshing instance network info cache due to event network-changed-5e1d6240-9d0b-4c83-9674-16d633e92bde. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-450ee95b-7f9e-43f4-a03c-0070aed79c1b req-54a0404e-1975-4343-b4d4-325655fbf02e service nova] Acquiring lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updating instance_info_cache with network_info: [{"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Releasing lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Instance network_info: |[{"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-450ee95b-7f9e-43f4-a03c-0070aed79c1b req-54a0404e-1975-4343-b4d4-325655fbf02e service nova] Acquired lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-450ee95b-7f9e-43f4-a03c-0070aed79c1b req-54a0404e-1975-4343-b4d4-325655fbf02e service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Refreshing network info cache for port 5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG nova.network.neutron [req-450ee95b-7f9e-43f4-a03c-0070aed79c1b req-54a0404e-1975-4343-b4d4-325655fbf02e service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updated VIF entry in instance network info cache for port 5e1d6240-9d0b-4c83-9674-16d633e92bde. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG nova.network.neutron [req-450ee95b-7f9e-43f4-a03c-0070aed79c1b req-54a0404e-1975-4343-b4d4-325655fbf02e service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updating instance_info_cache with network_info: [{"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-450ee95b-7f9e-43f4-a03c-0070aed79c1b req-54a0404e-1975-4343-b4d4-325655fbf02e service nova] Releasing lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:24 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:11:24 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7391MB free_disk=25.444198608398438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1f24f442-1547-4f20-ba7c-f7790dcc37af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance b2696233-b1c2-466d-92f1-0a30c3db1501 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance aa9e5564-b68f-42b4-9263-709641bde28b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 622d19bf-0618-49a9-9f71-b632d9e11301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 26a6a013-500d-4502-a9f1-cffef3c4ba27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d66f2088-97a5-4fff-9c0c-3b89b61a2870 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:11:24 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:11:25 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:11:25 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:11:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG os_brick.utils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d063667b-ab9b-4998-9b9f-d525a70caf85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe0c7d-07a1-46d3-8202-f825050dc32c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dfc49f-1715-473c-bde1-fcf8f31d54cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b380eb24-cb0d-4f61-a6a7-b743bc84fb26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:26 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:11:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc463127-4fae-40cf-b24a-a542f6617204]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG os_brick.utils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:26 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updating existing volume attachment record: a3d1b551-6d6e-4c2b-a7d5-f35574e4b3ed {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:11:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:11:31 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Creating image(s)
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Ensure instance console log exists: /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Start _get_guest_xml network_info=[{"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELZUBViw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd453ca1b-600f-40a9-9478-60ae619302ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'd62c2b92-9d2a-4d53-a265-ff059dab8844', 'serial': 'd62c2b92-9d2a-4d53-a265-ff059dab8844'}, 'attachment_id': 'a3d1b551-6d6e-4c2b-a7d5-f35574e4b3ed', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:11:31 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:11:31 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELZUBViw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:31 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:31 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:31 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc0d40c-c973-4d38-a1d2-df0b771dc9e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:11:31 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6595223a-7ba3-439d-bf40-2473e30d92ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844] added
Nov 14 19:11:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddea170-7a6a-42ef-92b6-4ddec3d5294c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e681989d-fe26-439e-92c4-d0e39efc77f8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELZUBViw {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELZUBViw" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecaeac3-8f33-445d-87c4-c44f0df86a26]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELZUBViw'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85234ec-876c-4fec-a694-e1bb8116420c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a4cfa6-63c5-4dca-a8bb-7b33c43b7883]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef27a594-f94f-44de-8111-b9d2776ed22d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844, portal: 172.16.0.220,3260]
Nov 14 19:11:31 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844, portal: 172.16.0.220,3260] successful.
Nov 14 19:11:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710fe6c-641b-4625-a09d-6b369e28424e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fb0755-7c04-4182-acc5-6bd9021a0165]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[22422fe0-f8ad-4505-ad55-adfcbc5c2fce]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:11:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELZUBViw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26665633466663030', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665633466663030', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2107882720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2107882720',id=13,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-nnfvmpga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:21Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=d453ca1b-600f-40a9-9478-60ae619302ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4e:6d,bridge_name='br-int',has_traffic_filtering=True,id=5e1d6240-9d0b-4c83-9674-16d633e92bde,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1d6240-9d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'pci_devices' on Instance uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:11:32 user nova-compute[75205]:   <uuid>d453ca1b-600f-40a9-9478-60ae619302ca</uuid>
Nov 14 19:11:32 user nova-compute[75205]:   <name>instance-0000000d</name>
Nov 14 19:11:32 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:11:32 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:11:32 user nova-compute[75205]:   <metadata>
Nov 14 19:11:32 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:11:32 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:11:32 user nova-compute[75205]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2107882720</nova:name>
Nov 14 19:11:32 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:11:31</nova:creationTime>
Nov 14 19:11:32 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:11:32 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:11:32 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:11:32 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:11:32 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:11:32 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:11:32 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:11:32 user nova-compute[75205]:       <nova:owner>
Nov 14 19:11:32 user nova-compute[75205]:         <nova:user uuid="d0ee9d2093e64175b45b3b4d99b5648f">tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member</nova:user>
Nov 14 19:11:32 user nova-compute[75205]:         <nova:project uuid="fde587867310451cab4f464b330555af">tempest-ServerBootFromVolumeStableRescueTest-2146587572</nova:project>
Nov 14 19:11:32 user nova-compute[75205]:       </nova:owner>
Nov 14 19:11:32 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:11:32 user nova-compute[75205]:       <nova:ports>
Nov 14 19:11:32 user nova-compute[75205]:         <nova:port uuid="5e1d6240-9d0b-4c83-9674-16d633e92bde">
Nov 14 19:11:32 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:11:32 user nova-compute[75205]:         </nova:port>
Nov 14 19:11:32 user nova-compute[75205]:       </nova:ports>
Nov 14 19:11:32 user nova-compute[75205]:     </nova:instance>
Nov 14 19:11:32 user nova-compute[75205]:   </metadata>
Nov 14 19:11:32 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:11:32 user nova-compute[75205]:     <system>
Nov 14 19:11:32 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:11:32 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:11:32 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:11:32 user nova-compute[75205]:       <entry name="serial">d453ca1b-600f-40a9-9478-60ae619302ca</entry>
Nov 14 19:11:32 user nova-compute[75205]:       <entry name="uuid">d453ca1b-600f-40a9-9478-60ae619302ca</entry>
Nov 14 19:11:32 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:11:32 user nova-compute[75205]:     </system>
Nov 14 19:11:32 user nova-compute[75205]:   </sysinfo>
Nov 14 19:11:32 user nova-compute[75205]:   <os>
Nov 14 19:11:32 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:11:32 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:11:32 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:11:32 user nova-compute[75205]:   </os>
Nov 14 19:11:32 user nova-compute[75205]:   <features>
Nov 14 19:11:32 user nova-compute[75205]:     <acpi/>
Nov 14 19:11:32 user nova-compute[75205]:     <apic/>
Nov 14 19:11:32 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:11:32 user nova-compute[75205]:   </features>
Nov 14 19:11:32 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:11:32 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:11:32 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:11:32 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:11:32 user nova-compute[75205]:   </clock>
Nov 14 19:11:32 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:11:32 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:11:32 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:11:32 user nova-compute[75205]:   </cpu>
Nov 14 19:11:32 user nova-compute[75205]:   <devices>
Nov 14 19:11:32 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:11:32 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:11:32 user nova-compute[75205]:       <source dev="/dev/sdb"/>
Nov 14 19:11:32 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:11:32 user nova-compute[75205]:       <serial>d62c2b92-9d2a-4d53-a265-ff059dab8844</serial>
Nov 14 19:11:32 user nova-compute[75205]:     </disk>
Nov 14 19:11:32 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:11:32 user nova-compute[75205]:       <mac address="fa:16:3e:02:4e:6d"/>
Nov 14 19:11:32 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:11:32 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:11:32 user nova-compute[75205]:       <target dev="tap5e1d6240-9d"/>
Nov 14 19:11:32 user nova-compute[75205]:     </interface>
Nov 14 19:11:32 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:11:32 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/console.log" append="off"/>
Nov 14 19:11:32 user nova-compute[75205]:     </serial>
Nov 14 19:11:32 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:11:32 user nova-compute[75205]:     <video>
Nov 14 19:11:32 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:11:32 user nova-compute[75205]:     </video>
Nov 14 19:11:32 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:11:32 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:11:32 user nova-compute[75205]:     </rng>
Nov 14 19:11:32 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:11:32 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:11:32 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:11:32 user nova-compute[75205]:     </memballoon>
Nov 14 19:11:32 user nova-compute[75205]:   </devices>
Nov 14 19:11:32 user nova-compute[75205]: </domain>
Nov 14 19:11:32 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2107882720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2107882720',id=13,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-nnfvmpga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:21Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=d453ca1b-600f-40a9-9478-60ae619302ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4e:6d,bridge_name='br-int',has_traffic_filtering=True,id=5e1d6240-9d0b-4c83-9674-16d633e92bde,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1d6240-9d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG os_vif [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4e:6d,bridge_name='br-int',has_traffic_filtering=True,id=5e1d6240-9d0b-4c83-9674-16d633e92bde,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1d6240-9d') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa322cb9-a287-598c-a9d0-53dd5517cd03', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e1d6240-9d, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e1d6240-9d, col_values=(('qos', UUID('3d24d795-a00e-4da4-80ae-50c8278f5f1e')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e1d6240-9d, col_values=(('external_ids', {'iface-id': '5e1d6240-9d0b-4c83-9674-16d633e92bde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:4e:6d', 'vm-uuid': 'd453ca1b-600f-40a9-9478-60ae619302ca'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:32 user nova-compute[75205]: INFO os_vif [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4e:6d,bridge_name='br-int',has_traffic_filtering=True,id=5e1d6240-9d0b-4c83-9674-16d633e92bde,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1d6240-9d')
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:11:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No VIF found with MAC fa:16:3e:02:4e:6d, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Waiting for libvirt event about the detach of device tap8abdb7de-37 with device alias net1 from instance b2696233-b1c2-466d-92f1-0a30c3db1501 is timed out.
Nov 14 19:11:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b9:c0:58"/><model type="virtio"/><mtu size="1442"/><target dev="tap8abdb7de-37"/></interface> {{(pid=75205) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b9:c0:58"/><model type="virtio"/><mtu size="1442"/><target dev="tap8abdb7de-37"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 14 19:11:34 user nova-compute[75205]:   <name>instance-00000006</name>
Nov 14 19:11:34 user nova-compute[75205]:   <uuid>b2696233-b1c2-466d-92f1-0a30c3db1501</uuid>
Nov 14 19:11:34 user nova-compute[75205]:   <metadata>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:11:34 user nova-compute[75205]:   <nova:package version="0.0.0"/>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:name>tempest-device-tagging-server-923454376</nova:name>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:creationTime>2023-11-14 19:10:42</nova:creationTime>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:flavor name="m1.tiny">
Nov 14 19:11:34 user nova-compute[75205]:     <nova:memory>512</nova:memory>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:disk>1</nova:disk>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:swap>0</nova:swap>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:vcpus>1</nova:vcpus>
Nov 14 19:11:34 user nova-compute[75205]:   </nova:flavor>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:owner>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:user uuid="65487f5c81204b0d86821d4a0eec289c">tempest-TaggedAttachmentsTest-551564993-project-member</nova:user>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:project uuid="11eaa2f5d6a94a368051677cc0d85b33">tempest-TaggedAttachmentsTest-551564993</nova:project>
Nov 14 19:11:34 user nova-compute[75205]:   </nova:owner>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:ports>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:port uuid="56984858-000b-45d7-a6f0-13dc113e14f6">
Nov 14 19:11:34 user nova-compute[75205]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:11:34 user nova-compute[75205]:     </nova:port>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:port uuid="8abdb7de-37af-4d8f-986b-a37a25d32001">
Nov 14 19:11:34 user nova-compute[75205]:       <nova:ip type="fixed" address="10.10.10.188" ipVersion="4"/>
Nov 14 19:11:34 user nova-compute[75205]:     </nova:port>
Nov 14 19:11:34 user nova-compute[75205]:   </nova:ports>
Nov 14 19:11:34 user nova-compute[75205]: </nova:instance>
Nov 14 19:11:34 user nova-compute[75205]:   </metadata>
Nov 14 19:11:34 user nova-compute[75205]:   <memory unit='KiB'>524288</memory>
Nov 14 19:11:34 user nova-compute[75205]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 19:11:34 user nova-compute[75205]:   <vcpu placement='static'>1</vcpu>
Nov 14 19:11:34 user nova-compute[75205]:   <resource>
Nov 14 19:11:34 user nova-compute[75205]:     <partition>/machine</partition>
Nov 14 19:11:34 user nova-compute[75205]:   </resource>
Nov 14 19:11:34 user nova-compute[75205]:   <sysinfo type='smbios'>
Nov 14 19:11:34 user nova-compute[75205]:     <system>
Nov 14 19:11:34 user nova-compute[75205]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 19:11:34 user nova-compute[75205]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 19:11:34 user nova-compute[75205]:       <entry name='version'>0.0.0</entry>
Nov 14 19:11:34 user nova-compute[75205]:       <entry name='serial'>b2696233-b1c2-466d-92f1-0a30c3db1501</entry>
Nov 14 19:11:34 user nova-compute[75205]:       <entry name='uuid'>b2696233-b1c2-466d-92f1-0a30c3db1501</entry>
Nov 14 19:11:34 user nova-compute[75205]:       <entry name='family'>Virtual Machine</entry>
Nov 14 19:11:34 user nova-compute[75205]:     </system>
Nov 14 19:11:34 user nova-compute[75205]:   </sysinfo>
Nov 14 19:11:34 user nova-compute[75205]:   <os>
Nov 14 19:11:34 user nova-compute[75205]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 19:11:34 user nova-compute[75205]:     <boot dev='hd'/>
Nov 14 19:11:34 user nova-compute[75205]:     <smbios mode='sysinfo'/>
Nov 14 19:11:34 user nova-compute[75205]:   </os>
Nov 14 19:11:34 user nova-compute[75205]:   <features>
Nov 14 19:11:34 user nova-compute[75205]:     <acpi/>
Nov 14 19:11:34 user nova-compute[75205]:     <apic/>
Nov 14 19:11:34 user nova-compute[75205]:     <vmcoreinfo state='on'/>
Nov 14 19:11:34 user nova-compute[75205]:   </features>
Nov 14 19:11:34 user nova-compute[75205]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 19:11:34 user nova-compute[75205]:     <model fallback='forbid'>Nehalem</model>
Nov 14 19:11:34 user nova-compute[75205]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 19:11:34 user nova-compute[75205]:     <feature policy='require' name='vme'/>
Nov 14 19:11:34 user nova-compute[75205]:     <feature policy='require' name='x2apic'/>
Nov 14 19:11:34 user nova-compute[75205]:     <feature policy='require' name='hypervisor'/>
Nov 14 19:11:34 user nova-compute[75205]:   </cpu>
Nov 14 19:11:34 user nova-compute[75205]:   <clock offset='utc'>
Nov 14 19:11:34 user nova-compute[75205]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 19:11:34 user nova-compute[75205]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 19:11:34 user nova-compute[75205]:     <timer name='hpet' present='no'/>
Nov 14 19:11:34 user nova-compute[75205]:   </clock>
Nov 14 19:11:34 user nova-compute[75205]:   <on_poweroff>destroy</on_poweroff>
Nov 14 19:11:34 user nova-compute[75205]:   <on_reboot>restart</on_reboot>
Nov 14 19:11:34 user nova-compute[75205]:   <on_crash>destroy</on_crash>
Nov 14 19:11:34 user nova-compute[75205]:   <devices>
Nov 14 19:11:34 user nova-compute[75205]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 19:11:34 user nova-compute[75205]:     <disk type='file' device='disk'>
Nov 14 19:11:34 user nova-compute[75205]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 19:11:34 user nova-compute[75205]:       <source file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk' index='2'/>
Nov 14 19:11:34 user nova-compute[75205]:       <backingStore type='file' index='3'>
Nov 14 19:11:34 user nova-compute[75205]:         <format type='raw'/>
Nov 14 19:11:34 user nova-compute[75205]:         <source file='/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de'/>
Nov 14 19:11:34 user nova-compute[75205]:         <backingStore/>
Nov 14 19:11:34 user nova-compute[75205]:       </backingStore>
Nov 14 19:11:34 user nova-compute[75205]:       <target dev='vda' bus='virtio'/>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='virtio-disk0'/>
Nov 14 19:11:34 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </disk>
Nov 14 19:11:34 user nova-compute[75205]:     <disk type='file' device='cdrom'>
Nov 14 19:11:34 user nova-compute[75205]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 19:11:34 user nova-compute[75205]:       <source file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.config' index='1'/>
Nov 14 19:11:34 user nova-compute[75205]:       <backingStore/>
Nov 14 19:11:34 user nova-compute[75205]:       <target dev='hda' bus='ide'/>
Nov 14 19:11:34 user nova-compute[75205]:       <readonly/>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='ide0-0-0'/>
Nov 14 19:11:34 user nova-compute[75205]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </disk>
Nov 14 19:11:34 user nova-compute[75205]:     <controller type='usb' index='0' model='none'>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='usb'/>
Nov 14 19:11:34 user nova-compute[75205]:     </controller>
Nov 14 19:11:34 user nova-compute[75205]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='pci.0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </controller>
Nov 14 19:11:34 user nova-compute[75205]:     <controller type='ide' index='0'>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='ide'/>
Nov 14 19:11:34 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 19:11:34 user nova-compute[75205]:     </controller>
Nov 14 19:11:34 user nova-compute[75205]:     <interface type='ethernet'>
Nov 14 19:11:34 user nova-compute[75205]:       <mac address='fa:16:3e:e0:1f:1e'/>
Nov 14 19:11:34 user nova-compute[75205]:       <target dev='tap56984858-00'/>
Nov 14 19:11:34 user nova-compute[75205]:       <model type='virtio'/>
Nov 14 19:11:34 user nova-compute[75205]:       <mtu size='1442'/>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='net0'/>
Nov 14 19:11:34 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </interface>
Nov 14 19:11:34 user nova-compute[75205]:     <serial type='pty'>
Nov 14 19:11:34 user nova-compute[75205]:       <source path='/dev/pts/5'/>
Nov 14 19:11:34 user nova-compute[75205]:       <log file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/console.log' append='off'/>
Nov 14 19:11:34 user nova-compute[75205]:       <target type='isa-serial' port='0'>
Nov 14 19:11:34 user nova-compute[75205]:         <model name='isa-serial'/>
Nov 14 19:11:34 user nova-compute[75205]:       </target>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='serial0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </serial>
Nov 14 19:11:34 user nova-compute[75205]:     <console type='pty' tty='/dev/pts/5'>
Nov 14 19:11:34 user nova-compute[75205]:       <source path='/dev/pts/5'/>
Nov 14 19:11:34 user nova-compute[75205]:       <log file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/console.log' append='off'/>
Nov 14 19:11:34 user nova-compute[75205]:       <target type='serial' port='0'/>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='serial0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </console>
Nov 14 19:11:34 user nova-compute[75205]:     <input type='mouse' bus='ps2'>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='input0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </input>
Nov 14 19:11:34 user nova-compute[75205]:     <input type='keyboard' bus='ps2'>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='input1'/>
Nov 14 19:11:34 user nova-compute[75205]:     </input>
Nov 14 19:11:34 user nova-compute[75205]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 14 19:11:34 user nova-compute[75205]:       <listen type='address' address='0.0.0.0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </graphics>
Nov 14 19:11:34 user nova-compute[75205]:     <audio id='1' type='none'/>
Nov 14 19:11:34 user nova-compute[75205]:     <video>
Nov 14 19:11:34 user nova-compute[75205]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='video0'/>
Nov 14 19:11:34 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </video>
Nov 14 19:11:34 user nova-compute[75205]:     <memballoon model='virtio'>
Nov 14 19:11:34 user nova-compute[75205]:       <stats period='10'/>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='balloon0'/>
Nov 14 19:11:34 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </memballoon>
Nov 14 19:11:34 user nova-compute[75205]:     <rng model='virtio'>
Nov 14 19:11:34 user nova-compute[75205]:       <backend model='random'>/dev/urandom</backend>
Nov 14 19:11:34 user nova-compute[75205]:       <alias name='rng0'/>
Nov 14 19:11:34 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 19:11:34 user nova-compute[75205]:     </rng>
Nov 14 19:11:34 user nova-compute[75205]:   </devices>
Nov 14 19:11:34 user nova-compute[75205]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 19:11:34 user nova-compute[75205]:     <label>libvirt-b2696233-b1c2-466d-92f1-0a30c3db1501</label>
Nov 14 19:11:34 user nova-compute[75205]:     <imagelabel>libvirt-b2696233-b1c2-466d-92f1-0a30c3db1501</imagelabel>
Nov 14 19:11:34 user nova-compute[75205]:   </seclabel>
Nov 14 19:11:34 user nova-compute[75205]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 19:11:34 user nova-compute[75205]:     <label>+64055:+108</label>
Nov 14 19:11:34 user nova-compute[75205]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 19:11:34 user nova-compute[75205]:   </seclabel>
Nov 14 19:11:34 user nova-compute[75205]: </domain>
Nov 14 19:11:34 user nova-compute[75205]:  {{(pid=75205) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 19:11:34 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Successfully detached device tap8abdb7de-37 from instance b2696233-b1c2-466d-92f1-0a30c3db1501 from the live domain config.
Nov 14 19:11:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923454376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923454376',id=6,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkRIwsBeDyQ11FuXQIwqoygHpHsgf3Cdt8fX3locV211FBgH9EBzW/BZRFfpB5sEUt5eCT8S2LhivMEVz8NcFsdFBPYZakdFldF/6rJgd/n1gME/tmQkgZpjcxprOgRtg==',key_name='tempest-keypair-1747689188',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11eaa2f5d6a94a368051677cc0d85b33',ramdisk_id='',reservation_id='r-nrqchh9b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-551564993',owner_user_name='tempest-TaggedAttachmentsTest-551564993-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65487f5c81204b0d86821d4a0eec289c',uuid=b2696233-b1c2-466d-92f1-0a30c3db1501,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converting VIF {"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG os_vif [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8abdb7de-37, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=492f51e6-1730-478a-999c-93f2f3b2a287) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: INFO os_vif [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37')
Nov 14 19:11:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:11:34 user nova-compute[75205]:   <nova:package version="0.0.0"/>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:name>tempest-device-tagging-server-923454376</nova:name>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:creationTime>2023-11-14 19:11:34</nova:creationTime>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:flavor name="m1.tiny">
Nov 14 19:11:34 user nova-compute[75205]:     <nova:memory>512</nova:memory>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:disk>1</nova:disk>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:swap>0</nova:swap>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:vcpus>1</nova:vcpus>
Nov 14 19:11:34 user nova-compute[75205]:   </nova:flavor>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:owner>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:user uuid="65487f5c81204b0d86821d4a0eec289c">tempest-TaggedAttachmentsTest-551564993-project-member</nova:user>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:project uuid="11eaa2f5d6a94a368051677cc0d85b33">tempest-TaggedAttachmentsTest-551564993</nova:project>
Nov 14 19:11:34 user nova-compute[75205]:   </nova:owner>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:11:34 user nova-compute[75205]:   <nova:ports>
Nov 14 19:11:34 user nova-compute[75205]:     <nova:port uuid="56984858-000b-45d7-a6f0-13dc113e14f6">
Nov 14 19:11:34 user nova-compute[75205]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:11:34 user nova-compute[75205]:     </nova:port>
Nov 14 19:11:34 user nova-compute[75205]:   </nova:ports>
Nov 14 19:11:34 user nova-compute[75205]: </nova:instance>
Nov 14 19:11:34 user nova-compute[75205]:  {{(pid=75205) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-5b3fdac0-d825-4441-b29e-0e41d6d5f8b5 req-564b3c64-7a95-47cb-962e-0a335a2758b6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5b3fdac0-d825-4441-b29e-0e41d6d5f8b5 req-564b3c64-7a95-47cb-962e-0a335a2758b6 service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5b3fdac0-d825-4441-b29e-0e41d6d5f8b5 req-564b3c64-7a95-47cb-962e-0a335a2758b6 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5b3fdac0-d825-4441-b29e-0e41d6d5f8b5 req-564b3c64-7a95-47cb-962e-0a335a2758b6 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-5b3fdac0-d825-4441-b29e-0e41d6d5f8b5 req-564b3c64-7a95-47cb-962e-0a335a2758b6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:34 user nova-compute[75205]: WARNING nova.compute.manager [req-5b3fdac0-d825-4441-b29e-0e41d6d5f8b5 req-564b3c64-7a95-47cb-962e-0a335a2758b6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state building and task_state spawning.
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-deleted-8abdb7de-37af-4d8f-986b-a37a25d32001 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:35 user nova-compute[75205]: INFO nova.compute.manager [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Neutron deleted interface 8abdb7de-37af-4d8f-986b-a37a25d32001; detaching it from the instance and deleting it from the info cache
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.network.neutron [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updating instance_info_cache with network_info: [{"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquired lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.objects.instance [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] Lazy-loading 'system_metadata' on Instance uuid b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.objects.instance [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] Lazy-loading 'flavor' on Instance uuid b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.objects.base [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] Object Instance<b2696233-b1c2-466d-92f1-0a30c3db1501> lazy-loaded attributes: system_metadata,flavor {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923454376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923454376',id=6,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkRIwsBeDyQ11FuXQIwqoygHpHsgf3Cdt8fX3locV211FBgH9EBzW/BZRFfpB5sEUt5eCT8S2LhivMEVz8NcFsdFBPYZakdFldF/6rJgd/n1gME/tmQkgZpjcxprOgRtg==',key_name='tempest-keypair-1747689188',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11eaa2f5d6a94a368051677cc0d85b33',ramdisk_id='',reservation_id='r-nrqchh9b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-551564993',owner_user_name='tempest-TaggedAttachmentsTest-551564993-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65487f5c81204b0d86821d4a0eec289c',uuid=b2696233-b1c2-466d-92f1-0a30c3db1501,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.network.os_vif_util [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] Converting VIF {"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.network.os_vif_util [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b9:c0:58"/><model type="virtio"/><mtu size="1442"/><target dev="tap8abdb7de-37"/></interface> {{(pid=75205) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b9:c0:58"/><model type="virtio"/><mtu size="1442"/><target dev="tap8abdb7de-37"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 14 19:11:35 user nova-compute[75205]:   <name>instance-00000006</name>
Nov 14 19:11:35 user nova-compute[75205]:   <uuid>b2696233-b1c2-466d-92f1-0a30c3db1501</uuid>
Nov 14 19:11:35 user nova-compute[75205]:   <metadata>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:11:35 user nova-compute[75205]:   <nova:package version="0.0.0"/>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:name>tempest-device-tagging-server-923454376</nova:name>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:creationTime>2023-11-14 19:11:34</nova:creationTime>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:flavor name="m1.tiny">
Nov 14 19:11:35 user nova-compute[75205]:     <nova:memory>512</nova:memory>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:disk>1</nova:disk>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:swap>0</nova:swap>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:vcpus>1</nova:vcpus>
Nov 14 19:11:35 user nova-compute[75205]:   </nova:flavor>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:owner>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:user uuid="65487f5c81204b0d86821d4a0eec289c">tempest-TaggedAttachmentsTest-551564993-project-member</nova:user>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:project uuid="11eaa2f5d6a94a368051677cc0d85b33">tempest-TaggedAttachmentsTest-551564993</nova:project>
Nov 14 19:11:35 user nova-compute[75205]:   </nova:owner>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:ports>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:port uuid="56984858-000b-45d7-a6f0-13dc113e14f6">
Nov 14 19:11:35 user nova-compute[75205]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:11:35 user nova-compute[75205]:     </nova:port>
Nov 14 19:11:35 user nova-compute[75205]:   </nova:ports>
Nov 14 19:11:35 user nova-compute[75205]: </nova:instance>
Nov 14 19:11:35 user nova-compute[75205]:   </metadata>
Nov 14 19:11:35 user nova-compute[75205]:   <memory unit='KiB'>524288</memory>
Nov 14 19:11:35 user nova-compute[75205]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 19:11:35 user nova-compute[75205]:   <vcpu placement='static'>1</vcpu>
Nov 14 19:11:35 user nova-compute[75205]:   <resource>
Nov 14 19:11:35 user nova-compute[75205]:     <partition>/machine</partition>
Nov 14 19:11:35 user nova-compute[75205]:   </resource>
Nov 14 19:11:35 user nova-compute[75205]:   <sysinfo type='smbios'>
Nov 14 19:11:35 user nova-compute[75205]:     <system>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='version'>0.0.0</entry>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='serial'>b2696233-b1c2-466d-92f1-0a30c3db1501</entry>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='uuid'>b2696233-b1c2-466d-92f1-0a30c3db1501</entry>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='family'>Virtual Machine</entry>
Nov 14 19:11:35 user nova-compute[75205]:     </system>
Nov 14 19:11:35 user nova-compute[75205]:   </sysinfo>
Nov 14 19:11:35 user nova-compute[75205]:   <os>
Nov 14 19:11:35 user nova-compute[75205]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 19:11:35 user nova-compute[75205]:     <boot dev='hd'/>
Nov 14 19:11:35 user nova-compute[75205]:     <smbios mode='sysinfo'/>
Nov 14 19:11:35 user nova-compute[75205]:   </os>
Nov 14 19:11:35 user nova-compute[75205]:   <features>
Nov 14 19:11:35 user nova-compute[75205]:     <acpi/>
Nov 14 19:11:35 user nova-compute[75205]:     <apic/>
Nov 14 19:11:35 user nova-compute[75205]:     <vmcoreinfo state='on'/>
Nov 14 19:11:35 user nova-compute[75205]:   </features>
Nov 14 19:11:35 user nova-compute[75205]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 19:11:35 user nova-compute[75205]:     <model fallback='forbid'>Nehalem</model>
Nov 14 19:11:35 user nova-compute[75205]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 19:11:35 user nova-compute[75205]:     <feature policy='require' name='vme'/>
Nov 14 19:11:35 user nova-compute[75205]:     <feature policy='require' name='x2apic'/>
Nov 14 19:11:35 user nova-compute[75205]:     <feature policy='require' name='hypervisor'/>
Nov 14 19:11:35 user nova-compute[75205]:   </cpu>
Nov 14 19:11:35 user nova-compute[75205]:   <clock offset='utc'>
Nov 14 19:11:35 user nova-compute[75205]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 19:11:35 user nova-compute[75205]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 19:11:35 user nova-compute[75205]:     <timer name='hpet' present='no'/>
Nov 14 19:11:35 user nova-compute[75205]:   </clock>
Nov 14 19:11:35 user nova-compute[75205]:   <on_poweroff>destroy</on_poweroff>
Nov 14 19:11:35 user nova-compute[75205]:   <on_reboot>restart</on_reboot>
Nov 14 19:11:35 user nova-compute[75205]:   <on_crash>destroy</on_crash>
Nov 14 19:11:35 user nova-compute[75205]:   <devices>
Nov 14 19:11:35 user nova-compute[75205]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 19:11:35 user nova-compute[75205]:     <disk type='file' device='disk'>
Nov 14 19:11:35 user nova-compute[75205]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 19:11:35 user nova-compute[75205]:       <source file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk' index='2'/>
Nov 14 19:11:35 user nova-compute[75205]:       <backingStore type='file' index='3'>
Nov 14 19:11:35 user nova-compute[75205]:         <format type='raw'/>
Nov 14 19:11:35 user nova-compute[75205]:         <source file='/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de'/>
Nov 14 19:11:35 user nova-compute[75205]:         <backingStore/>
Nov 14 19:11:35 user nova-compute[75205]:       </backingStore>
Nov 14 19:11:35 user nova-compute[75205]:       <target dev='vda' bus='virtio'/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='virtio-disk0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </disk>
Nov 14 19:11:35 user nova-compute[75205]:     <disk type='file' device='cdrom'>
Nov 14 19:11:35 user nova-compute[75205]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 19:11:35 user nova-compute[75205]:       <source file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.config' index='1'/>
Nov 14 19:11:35 user nova-compute[75205]:       <backingStore/>
Nov 14 19:11:35 user nova-compute[75205]:       <target dev='hda' bus='ide'/>
Nov 14 19:11:35 user nova-compute[75205]:       <readonly/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='ide0-0-0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </disk>
Nov 14 19:11:35 user nova-compute[75205]:     <controller type='usb' index='0' model='none'>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='usb'/>
Nov 14 19:11:35 user nova-compute[75205]:     </controller>
Nov 14 19:11:35 user nova-compute[75205]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='pci.0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </controller>
Nov 14 19:11:35 user nova-compute[75205]:     <controller type='ide' index='0'>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='ide'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 19:11:35 user nova-compute[75205]:     </controller>
Nov 14 19:11:35 user nova-compute[75205]:     <interface type='ethernet'>
Nov 14 19:11:35 user nova-compute[75205]:       <mac address='fa:16:3e:e0:1f:1e'/>
Nov 14 19:11:35 user nova-compute[75205]:       <target dev='tap56984858-00'/>
Nov 14 19:11:35 user nova-compute[75205]:       <model type='virtio'/>
Nov 14 19:11:35 user nova-compute[75205]:       <mtu size='1442'/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='net0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </interface>
Nov 14 19:11:35 user nova-compute[75205]:     <serial type='pty'>
Nov 14 19:11:35 user nova-compute[75205]:       <source path='/dev/pts/5'/>
Nov 14 19:11:35 user nova-compute[75205]:       <log file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/console.log' append='off'/>
Nov 14 19:11:35 user nova-compute[75205]:       <target type='isa-serial' port='0'>
Nov 14 19:11:35 user nova-compute[75205]:         <model name='isa-serial'/>
Nov 14 19:11:35 user nova-compute[75205]:       </target>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='serial0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </serial>
Nov 14 19:11:35 user nova-compute[75205]:     <console type='pty' tty='/dev/pts/5'>
Nov 14 19:11:35 user nova-compute[75205]:       <source path='/dev/pts/5'/>
Nov 14 19:11:35 user nova-compute[75205]:       <log file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/console.log' append='off'/>
Nov 14 19:11:35 user nova-compute[75205]:       <target type='serial' port='0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='serial0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </console>
Nov 14 19:11:35 user nova-compute[75205]:     <input type='mouse' bus='ps2'>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='input0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </input>
Nov 14 19:11:35 user nova-compute[75205]:     <input type='keyboard' bus='ps2'>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='input1'/>
Nov 14 19:11:35 user nova-compute[75205]:     </input>
Nov 14 19:11:35 user nova-compute[75205]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 14 19:11:35 user nova-compute[75205]:       <listen type='address' address='0.0.0.0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </graphics>
Nov 14 19:11:35 user nova-compute[75205]:     <audio id='1' type='none'/>
Nov 14 19:11:35 user nova-compute[75205]:     <video>
Nov 14 19:11:35 user nova-compute[75205]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='video0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </video>
Nov 14 19:11:35 user nova-compute[75205]:     <memballoon model='virtio'>
Nov 14 19:11:35 user nova-compute[75205]:       <stats period='10'/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='balloon0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </memballoon>
Nov 14 19:11:35 user nova-compute[75205]:     <rng model='virtio'>
Nov 14 19:11:35 user nova-compute[75205]:       <backend model='random'>/dev/urandom</backend>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='rng0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </rng>
Nov 14 19:11:35 user nova-compute[75205]:   </devices>
Nov 14 19:11:35 user nova-compute[75205]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 19:11:35 user nova-compute[75205]:     <label>libvirt-b2696233-b1c2-466d-92f1-0a30c3db1501</label>
Nov 14 19:11:35 user nova-compute[75205]:     <imagelabel>libvirt-b2696233-b1c2-466d-92f1-0a30c3db1501</imagelabel>
Nov 14 19:11:35 user nova-compute[75205]:   </seclabel>
Nov 14 19:11:35 user nova-compute[75205]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 19:11:35 user nova-compute[75205]:     <label>+64055:+108</label>
Nov 14 19:11:35 user nova-compute[75205]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 19:11:35 user nova-compute[75205]:   </seclabel>
Nov 14 19:11:35 user nova-compute[75205]: </domain>
Nov 14 19:11:35 user nova-compute[75205]:  {{(pid=75205) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b9:c0:58"/><model type="virtio"/><mtu size="1442"/><target dev="tap8abdb7de-37"/></interface> {{(pid=75205) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b9:c0:58"/><model type="virtio"/><mtu size="1442"/><target dev="tap8abdb7de-37"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 14 19:11:35 user nova-compute[75205]:   <name>instance-00000006</name>
Nov 14 19:11:35 user nova-compute[75205]:   <uuid>b2696233-b1c2-466d-92f1-0a30c3db1501</uuid>
Nov 14 19:11:35 user nova-compute[75205]:   <metadata>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:11:35 user nova-compute[75205]:   <nova:package version="0.0.0"/>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:name>tempest-device-tagging-server-923454376</nova:name>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:creationTime>2023-11-14 19:11:34</nova:creationTime>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:flavor name="m1.tiny">
Nov 14 19:11:35 user nova-compute[75205]:     <nova:memory>512</nova:memory>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:disk>1</nova:disk>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:swap>0</nova:swap>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:vcpus>1</nova:vcpus>
Nov 14 19:11:35 user nova-compute[75205]:   </nova:flavor>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:owner>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:user uuid="65487f5c81204b0d86821d4a0eec289c">tempest-TaggedAttachmentsTest-551564993-project-member</nova:user>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:project uuid="11eaa2f5d6a94a368051677cc0d85b33">tempest-TaggedAttachmentsTest-551564993</nova:project>
Nov 14 19:11:35 user nova-compute[75205]:   </nova:owner>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:ports>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:port uuid="56984858-000b-45d7-a6f0-13dc113e14f6">
Nov 14 19:11:35 user nova-compute[75205]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:11:35 user nova-compute[75205]:     </nova:port>
Nov 14 19:11:35 user nova-compute[75205]:   </nova:ports>
Nov 14 19:11:35 user nova-compute[75205]: </nova:instance>
Nov 14 19:11:35 user nova-compute[75205]:   </metadata>
Nov 14 19:11:35 user nova-compute[75205]:   <memory unit='KiB'>524288</memory>
Nov 14 19:11:35 user nova-compute[75205]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 19:11:35 user nova-compute[75205]:   <vcpu placement='static'>1</vcpu>
Nov 14 19:11:35 user nova-compute[75205]:   <resource>
Nov 14 19:11:35 user nova-compute[75205]:     <partition>/machine</partition>
Nov 14 19:11:35 user nova-compute[75205]:   </resource>
Nov 14 19:11:35 user nova-compute[75205]:   <sysinfo type='smbios'>
Nov 14 19:11:35 user nova-compute[75205]:     <system>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='version'>0.0.0</entry>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='serial'>b2696233-b1c2-466d-92f1-0a30c3db1501</entry>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='uuid'>b2696233-b1c2-466d-92f1-0a30c3db1501</entry>
Nov 14 19:11:35 user nova-compute[75205]:       <entry name='family'>Virtual Machine</entry>
Nov 14 19:11:35 user nova-compute[75205]:     </system>
Nov 14 19:11:35 user nova-compute[75205]:   </sysinfo>
Nov 14 19:11:35 user nova-compute[75205]:   <os>
Nov 14 19:11:35 user nova-compute[75205]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 19:11:35 user nova-compute[75205]:     <boot dev='hd'/>
Nov 14 19:11:35 user nova-compute[75205]:     <smbios mode='sysinfo'/>
Nov 14 19:11:35 user nova-compute[75205]:   </os>
Nov 14 19:11:35 user nova-compute[75205]:   <features>
Nov 14 19:11:35 user nova-compute[75205]:     <acpi/>
Nov 14 19:11:35 user nova-compute[75205]:     <apic/>
Nov 14 19:11:35 user nova-compute[75205]:     <vmcoreinfo state='on'/>
Nov 14 19:11:35 user nova-compute[75205]:   </features>
Nov 14 19:11:35 user nova-compute[75205]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 19:11:35 user nova-compute[75205]:     <model fallback='forbid'>Nehalem</model>
Nov 14 19:11:35 user nova-compute[75205]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 19:11:35 user nova-compute[75205]:     <feature policy='require' name='vme'/>
Nov 14 19:11:35 user nova-compute[75205]:     <feature policy='require' name='x2apic'/>
Nov 14 19:11:35 user nova-compute[75205]:     <feature policy='require' name='hypervisor'/>
Nov 14 19:11:35 user nova-compute[75205]:   </cpu>
Nov 14 19:11:35 user nova-compute[75205]:   <clock offset='utc'>
Nov 14 19:11:35 user nova-compute[75205]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 19:11:35 user nova-compute[75205]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 19:11:35 user nova-compute[75205]:     <timer name='hpet' present='no'/>
Nov 14 19:11:35 user nova-compute[75205]:   </clock>
Nov 14 19:11:35 user nova-compute[75205]:   <on_poweroff>destroy</on_poweroff>
Nov 14 19:11:35 user nova-compute[75205]:   <on_reboot>restart</on_reboot>
Nov 14 19:11:35 user nova-compute[75205]:   <on_crash>destroy</on_crash>
Nov 14 19:11:35 user nova-compute[75205]:   <devices>
Nov 14 19:11:35 user nova-compute[75205]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 19:11:35 user nova-compute[75205]:     <disk type='file' device='disk'>
Nov 14 19:11:35 user nova-compute[75205]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 19:11:35 user nova-compute[75205]:       <source file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk' index='2'/>
Nov 14 19:11:35 user nova-compute[75205]:       <backingStore type='file' index='3'>
Nov 14 19:11:35 user nova-compute[75205]:         <format type='raw'/>
Nov 14 19:11:35 user nova-compute[75205]:         <source file='/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de'/>
Nov 14 19:11:35 user nova-compute[75205]:         <backingStore/>
Nov 14 19:11:35 user nova-compute[75205]:       </backingStore>
Nov 14 19:11:35 user nova-compute[75205]:       <target dev='vda' bus='virtio'/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='virtio-disk0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </disk>
Nov 14 19:11:35 user nova-compute[75205]:     <disk type='file' device='cdrom'>
Nov 14 19:11:35 user nova-compute[75205]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 19:11:35 user nova-compute[75205]:       <source file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/disk.config' index='1'/>
Nov 14 19:11:35 user nova-compute[75205]:       <backingStore/>
Nov 14 19:11:35 user nova-compute[75205]:       <target dev='hda' bus='ide'/>
Nov 14 19:11:35 user nova-compute[75205]:       <readonly/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='ide0-0-0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </disk>
Nov 14 19:11:35 user nova-compute[75205]:     <controller type='usb' index='0' model='none'>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='usb'/>
Nov 14 19:11:35 user nova-compute[75205]:     </controller>
Nov 14 19:11:35 user nova-compute[75205]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='pci.0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </controller>
Nov 14 19:11:35 user nova-compute[75205]:     <controller type='ide' index='0'>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='ide'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 19:11:35 user nova-compute[75205]:     </controller>
Nov 14 19:11:35 user nova-compute[75205]:     <interface type='ethernet'>
Nov 14 19:11:35 user nova-compute[75205]:       <mac address='fa:16:3e:e0:1f:1e'/>
Nov 14 19:11:35 user nova-compute[75205]:       <target dev='tap56984858-00'/>
Nov 14 19:11:35 user nova-compute[75205]:       <model type='virtio'/>
Nov 14 19:11:35 user nova-compute[75205]:       <mtu size='1442'/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='net0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </interface>
Nov 14 19:11:35 user nova-compute[75205]:     <serial type='pty'>
Nov 14 19:11:35 user nova-compute[75205]:       <source path='/dev/pts/5'/>
Nov 14 19:11:35 user nova-compute[75205]:       <log file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/console.log' append='off'/>
Nov 14 19:11:35 user nova-compute[75205]:       <target type='isa-serial' port='0'>
Nov 14 19:11:35 user nova-compute[75205]:         <model name='isa-serial'/>
Nov 14 19:11:35 user nova-compute[75205]:       </target>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='serial0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </serial>
Nov 14 19:11:35 user nova-compute[75205]:     <console type='pty' tty='/dev/pts/5'>
Nov 14 19:11:35 user nova-compute[75205]:       <source path='/dev/pts/5'/>
Nov 14 19:11:35 user nova-compute[75205]:       <log file='/opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501/console.log' append='off'/>
Nov 14 19:11:35 user nova-compute[75205]:       <target type='serial' port='0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='serial0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </console>
Nov 14 19:11:35 user nova-compute[75205]:     <input type='mouse' bus='ps2'>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='input0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </input>
Nov 14 19:11:35 user nova-compute[75205]:     <input type='keyboard' bus='ps2'>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='input1'/>
Nov 14 19:11:35 user nova-compute[75205]:     </input>
Nov 14 19:11:35 user nova-compute[75205]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 14 19:11:35 user nova-compute[75205]:       <listen type='address' address='0.0.0.0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </graphics>
Nov 14 19:11:35 user nova-compute[75205]:     <audio id='1' type='none'/>
Nov 14 19:11:35 user nova-compute[75205]:     <video>
Nov 14 19:11:35 user nova-compute[75205]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='video0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </video>
Nov 14 19:11:35 user nova-compute[75205]:     <memballoon model='virtio'>
Nov 14 19:11:35 user nova-compute[75205]:       <stats period='10'/>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='balloon0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </memballoon>
Nov 14 19:11:35 user nova-compute[75205]:     <rng model='virtio'>
Nov 14 19:11:35 user nova-compute[75205]:       <backend model='random'>/dev/urandom</backend>
Nov 14 19:11:35 user nova-compute[75205]:       <alias name='rng0'/>
Nov 14 19:11:35 user nova-compute[75205]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 19:11:35 user nova-compute[75205]:     </rng>
Nov 14 19:11:35 user nova-compute[75205]:   </devices>
Nov 14 19:11:35 user nova-compute[75205]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 19:11:35 user nova-compute[75205]:     <label>libvirt-b2696233-b1c2-466d-92f1-0a30c3db1501</label>
Nov 14 19:11:35 user nova-compute[75205]:     <imagelabel>libvirt-b2696233-b1c2-466d-92f1-0a30c3db1501</imagelabel>
Nov 14 19:11:35 user nova-compute[75205]:   </seclabel>
Nov 14 19:11:35 user nova-compute[75205]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 19:11:35 user nova-compute[75205]:     <label>+64055:+108</label>
Nov 14 19:11:35 user nova-compute[75205]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 19:11:35 user nova-compute[75205]:   </seclabel>
Nov 14 19:11:35 user nova-compute[75205]: </domain>
Nov 14 19:11:35 user nova-compute[75205]:  {{(pid=75205) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 19:11:35 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Detaching interface fa:16:3e:b9:c0:58 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8abdb7de-37' not found.
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923454376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923454376',id=6,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkRIwsBeDyQ11FuXQIwqoygHpHsgf3Cdt8fX3locV211FBgH9EBzW/BZRFfpB5sEUt5eCT8S2LhivMEVz8NcFsdFBPYZakdFldF/6rJgd/n1gME/tmQkgZpjcxprOgRtg==',key_name='tempest-keypair-1747689188',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11eaa2f5d6a94a368051677cc0d85b33',ramdisk_id='',reservation_id='r-nrqchh9b',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-551564993',owner_user_name='tempest-TaggedAttachmentsTest-551564993-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65487f5c81204b0d86821d4a0eec289c',uuid=b2696233-b1c2-466d-92f1-0a30c3db1501,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.network.os_vif_util [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] Converting VIF {"id": "8abdb7de-37af-4d8f-986b-a37a25d32001", "address": "fa:16:3e:b9:c0:58", "network": {"id": "e63ba746-93d4-43d8-951f-7de17b072ad9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1000486321", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abdb7de-37", "ovs_interfaceid": "8abdb7de-37af-4d8f-986b-a37a25d32001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.network.os_vif_util [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG os_vif [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8abdb7de-37, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:11:35 user nova-compute[75205]: INFO os_vif [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c0:58,bridge_name='br-int',has_traffic_filtering=True,id=8abdb7de-37af-4d8f-986b-a37a25d32001,network=Network(e63ba746-93d4-43d8-951f-7de17b072ad9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abdb7de-37')
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [req-a1391d91-23f8-4d58-b47b-567fc2407de5 req-a0120445-6f72-441c-90a0-f5d68207b62d service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:11:35 user nova-compute[75205]:   <nova:package version="0.0.0"/>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:name>tempest-device-tagging-server-923454376</nova:name>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:creationTime>2023-11-14 19:11:35</nova:creationTime>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:flavor name="m1.tiny">
Nov 14 19:11:35 user nova-compute[75205]:     <nova:memory>512</nova:memory>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:disk>1</nova:disk>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:swap>0</nova:swap>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:vcpus>1</nova:vcpus>
Nov 14 19:11:35 user nova-compute[75205]:   </nova:flavor>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:owner>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:user uuid="65487f5c81204b0d86821d4a0eec289c">tempest-TaggedAttachmentsTest-551564993-project-member</nova:user>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:project uuid="11eaa2f5d6a94a368051677cc0d85b33">tempest-TaggedAttachmentsTest-551564993</nova:project>
Nov 14 19:11:35 user nova-compute[75205]:   </nova:owner>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:11:35 user nova-compute[75205]:   <nova:ports>
Nov 14 19:11:35 user nova-compute[75205]:     <nova:port uuid="56984858-000b-45d7-a6f0-13dc113e14f6">
Nov 14 19:11:35 user nova-compute[75205]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:11:35 user nova-compute[75205]:     </nova:port>
Nov 14 19:11:35 user nova-compute[75205]:   </nova:ports>
Nov 14 19:11:35 user nova-compute[75205]: </nova:instance>
Nov 14 19:11:35 user nova-compute[75205]:  {{(pid=75205) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updating instance_info_cache with network_info: [{"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Releasing lock "refresh_cache-b2696233-b1c2-466d-92f1-0a30c3db1501" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10566a3-5578-4dd5-b6a3-0a711535b126 tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "interface-b2696233-b1c2-466d-92f1-0a30c3db1501-8abdb7de-37af-4d8f-986b-a37a25d32001" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.969s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:11:36 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Instance spawned successfully.
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.compute.manager [req-f798500f-ec9f-41fb-942e-4706ba0e1647 req-f163f977-ffff-4156-a43a-bee7557c9565 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f798500f-ec9f-41fb-942e-4706ba0e1647 req-f163f977-ffff-4156-a43a-bee7557c9565 service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f798500f-ec9f-41fb-942e-4706ba0e1647 req-f163f977-ffff-4156-a43a-bee7557c9565 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f798500f-ec9f-41fb-942e-4706ba0e1647 req-f163f977-ffff-4156-a43a-bee7557c9565 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.compute.manager [req-f798500f-ec9f-41fb-942e-4706ba0e1647 req-f163f977-ffff-4156-a43a-bee7557c9565 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:36 user nova-compute[75205]: WARNING nova.compute.manager [req-f798500f-ec9f-41fb-942e-4706ba0e1647 req-f163f977-ffff-4156-a43a-bee7557c9565 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state building and task_state spawning.
Nov 14 19:11:36 user nova-compute[75205]: INFO nova.compute.manager [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:11:36 user nova-compute[75205]: INFO nova.compute.manager [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Took 16.71 seconds to build instance.
Nov 14 19:11:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "55940268-4985-49a7-8e4d-baa0051122cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "55940268-4985-49a7-8e4d-baa0051122cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ca2ed859-010e-4c56-ab9f-77e775b1c5b4 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "d453ca1b-600f-40a9-9478-60ae619302ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.825s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:11:36 user nova-compute[75205]: INFO nova.compute.claims [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Claim successful on node user
Nov 14 19:11:37 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:11:37 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:11:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG nova.policy [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53dc67514dda4ef7b51122f81c6feb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba7425d60794409b74ed4fe0e902536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:11:37 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Creating image(s)
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "/opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "/opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "/opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.191s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk 1073741824" returned: 0 in 0.050s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Successfully created port: 4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.209s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Cannot resize image /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Ensure instance console log exists: /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG nova.compute.manager [req-d1d22173-07c8-448a-81c2-049ee5b60805 req-11d73564-bea7-4c2a-8277-447f4e9dd7ad service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-changed-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG nova.compute.manager [req-d1d22173-07c8-448a-81c2-049ee5b60805 req-11d73564-bea7-4c2a-8277-447f4e9dd7ad service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Refreshing instance network info cache due to event network-changed-d78d73b9-cc60-4324-b5e4-2dede8700c73. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d1d22173-07c8-448a-81c2-049ee5b60805 req-11d73564-bea7-4c2a-8277-447f4e9dd7ad service nova] Acquiring lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d1d22173-07c8-448a-81c2-049ee5b60805 req-11d73564-bea7-4c2a-8277-447f4e9dd7ad service nova] Acquired lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG nova.network.neutron [req-d1d22173-07c8-448a-81c2-049ee5b60805 req-11d73564-bea7-4c2a-8277-447f4e9dd7ad service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Refreshing network info cache for port d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:38 user nova-compute[75205]: INFO nova.compute.manager [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Shelve offloading
Nov 14 19:11:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-eb42c157-af6c-4cec-949e-4026c7c8f443 req-8beca891-1952-4a67-adf2-b12e9ec2472d service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-vif-unplugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb42c157-af6c-4cec-949e-4026c7c8f443 req-8beca891-1952-4a67-adf2-b12e9ec2472d service nova] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb42c157-af6c-4cec-949e-4026c7c8f443 req-8beca891-1952-4a67-adf2-b12e9ec2472d service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb42c157-af6c-4cec-949e-4026c7c8f443 req-8beca891-1952-4a67-adf2-b12e9ec2472d service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-eb42c157-af6c-4cec-949e-4026c7c8f443 req-8beca891-1952-4a67-adf2-b12e9ec2472d service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] No waiting events found dispatching network-vif-unplugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:39 user nova-compute[75205]: WARNING nova.compute.manager [req-eb42c157-af6c-4cec-949e-4026c7c8f443 req-8beca891-1952-4a67-adf2-b12e9ec2472d service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received unexpected event network-vif-unplugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 for instance with vm_state active and task_state shelving.
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Successfully updated port: 4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "refresh_cache-55940268-4985-49a7-8e4d-baa0051122cf" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquired lock "refresh_cache-55940268-4985-49a7-8e4d-baa0051122cf" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-d1d22173-07c8-448a-81c2-049ee5b60805 req-11d73564-bea7-4c2a-8277-447f4e9dd7ad service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updated VIF entry in instance network info cache for port d78d73b9-cc60-4324-b5e4-2dede8700c73. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-d1d22173-07c8-448a-81c2-049ee5b60805 req-11d73564-bea7-4c2a-8277-447f4e9dd7ad service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating instance_info_cache with network_info: [{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d1d22173-07c8-448a-81c2-049ee5b60805 req-11d73564-bea7-4c2a-8277-447f4e9dd7ad service nova] Releasing lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Instance destroyed successfully.
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquired lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.neutron [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Updating instance_info_cache with network_info: [{"id": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "address": "fa:16:3e:eb:89:51", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e335ab6-ea", "ovs_interfaceid": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Releasing lock "refresh_cache-55940268-4985-49a7-8e4d-baa0051122cf" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Instance network_info: |[{"id": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "address": "fa:16:3e:eb:89:51", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e335ab6-ea", "ovs_interfaceid": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Start _get_guest_xml network_info=[{"id": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "address": "fa:16:3e:eb:89:51", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e335ab6-ea", "ovs_interfaceid": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:11:39 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:11:39 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1922657440',display_name='tempest-VolumesAdminNegativeTest-server-1922657440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1922657440',id=14,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ba7425d60794409b74ed4fe0e902536',ramdisk_id='',reservation_id='r-vwqs8zml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-368867561',owner_user_name='tempest-VolumesAdminNegativeTest-368867561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:37Z,user_data=None,user_id='53dc67514dda4ef7b51122f81c6feb02',uuid=55940268-4985-49a7-8e4d-baa0051122cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "address": "fa:16:3e:eb:89:51", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e335ab6-ea", "ovs_interfaceid": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converting VIF {"id": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "address": "fa:16:3e:eb:89:51", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e335ab6-ea", "ovs_interfaceid": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:51,bridge_name='br-int',has_traffic_filtering=True,id=4e335ab6-ea34-4dcd-bcba-305388ca6f81,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e335ab6-ea') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.objects.instance [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lazy-loading 'pci_devices' on Instance uuid 55940268-4985-49a7-8e4d-baa0051122cf {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:11:39 user nova-compute[75205]:   <uuid>55940268-4985-49a7-8e4d-baa0051122cf</uuid>
Nov 14 19:11:39 user nova-compute[75205]:   <name>instance-0000000e</name>
Nov 14 19:11:39 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:11:39 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:11:39 user nova-compute[75205]:   <metadata>
Nov 14 19:11:39 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:11:39 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:11:39 user nova-compute[75205]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1922657440</nova:name>
Nov 14 19:11:39 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:11:39</nova:creationTime>
Nov 14 19:11:39 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:11:39 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:11:39 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:11:39 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:11:39 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:11:39 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:11:39 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:11:39 user nova-compute[75205]:       <nova:owner>
Nov 14 19:11:39 user nova-compute[75205]:         <nova:user uuid="53dc67514dda4ef7b51122f81c6feb02">tempest-VolumesAdminNegativeTest-368867561-project-member</nova:user>
Nov 14 19:11:39 user nova-compute[75205]:         <nova:project uuid="8ba7425d60794409b74ed4fe0e902536">tempest-VolumesAdminNegativeTest-368867561</nova:project>
Nov 14 19:11:39 user nova-compute[75205]:       </nova:owner>
Nov 14 19:11:39 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:11:39 user nova-compute[75205]:       <nova:ports>
Nov 14 19:11:39 user nova-compute[75205]:         <nova:port uuid="4e335ab6-ea34-4dcd-bcba-305388ca6f81">
Nov 14 19:11:39 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 19:11:39 user nova-compute[75205]:         </nova:port>
Nov 14 19:11:39 user nova-compute[75205]:       </nova:ports>
Nov 14 19:11:39 user nova-compute[75205]:     </nova:instance>
Nov 14 19:11:39 user nova-compute[75205]:   </metadata>
Nov 14 19:11:39 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:11:39 user nova-compute[75205]:     <system>
Nov 14 19:11:39 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:11:39 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:11:39 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:11:39 user nova-compute[75205]:       <entry name="serial">55940268-4985-49a7-8e4d-baa0051122cf</entry>
Nov 14 19:11:39 user nova-compute[75205]:       <entry name="uuid">55940268-4985-49a7-8e4d-baa0051122cf</entry>
Nov 14 19:11:39 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:11:39 user nova-compute[75205]:     </system>
Nov 14 19:11:39 user nova-compute[75205]:   </sysinfo>
Nov 14 19:11:39 user nova-compute[75205]:   <os>
Nov 14 19:11:39 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:11:39 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:11:39 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:11:39 user nova-compute[75205]:   </os>
Nov 14 19:11:39 user nova-compute[75205]:   <features>
Nov 14 19:11:39 user nova-compute[75205]:     <acpi/>
Nov 14 19:11:39 user nova-compute[75205]:     <apic/>
Nov 14 19:11:39 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:11:39 user nova-compute[75205]:   </features>
Nov 14 19:11:39 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:11:39 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:11:39 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:11:39 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:11:39 user nova-compute[75205]:   </clock>
Nov 14 19:11:39 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:11:39 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:11:39 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:11:39 user nova-compute[75205]:   </cpu>
Nov 14 19:11:39 user nova-compute[75205]:   <devices>
Nov 14 19:11:39 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:11:39 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:11:39 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk"/>
Nov 14 19:11:39 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:11:39 user nova-compute[75205]:     </disk>
Nov 14 19:11:39 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:11:39 user nova-compute[75205]:       <mac address="fa:16:3e:eb:89:51"/>
Nov 14 19:11:39 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:11:39 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:11:39 user nova-compute[75205]:       <target dev="tap4e335ab6-ea"/>
Nov 14 19:11:39 user nova-compute[75205]:     </interface>
Nov 14 19:11:39 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:11:39 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/console.log" append="off"/>
Nov 14 19:11:39 user nova-compute[75205]:     </serial>
Nov 14 19:11:39 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:11:39 user nova-compute[75205]:     <video>
Nov 14 19:11:39 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:11:39 user nova-compute[75205]:     </video>
Nov 14 19:11:39 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:11:39 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:11:39 user nova-compute[75205]:     </rng>
Nov 14 19:11:39 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:11:39 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:11:39 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:11:39 user nova-compute[75205]:     </memballoon>
Nov 14 19:11:39 user nova-compute[75205]:   </devices>
Nov 14 19:11:39 user nova-compute[75205]: </domain>
Nov 14 19:11:39 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1922657440',display_name='tempest-VolumesAdminNegativeTest-server-1922657440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1922657440',id=14,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ba7425d60794409b74ed4fe0e902536',ramdisk_id='',reservation_id='r-vwqs8zml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-368867561',owner_user_name='tempest-VolumesAdminNegativeTest-368867561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:37Z,user_data=None,user_id='53dc67514dda4ef7b51122f81c6feb02',uuid=55940268-4985-49a7-8e4d-baa0051122cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "address": "fa:16:3e:eb:89:51", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e335ab6-ea", "ovs_interfaceid": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converting VIF {"id": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "address": "fa:16:3e:eb:89:51", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e335ab6-ea", "ovs_interfaceid": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:51,bridge_name='br-int',has_traffic_filtering=True,id=4e335ab6-ea34-4dcd-bcba-305388ca6f81,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e335ab6-ea') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG os_vif [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:51,bridge_name='br-int',has_traffic_filtering=True,id=4e335ab6-ea34-4dcd-bcba-305388ca6f81,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e335ab6-ea') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d431075-998e-5ac1-a3f4-53eea1213231', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e335ab6-ea, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e335ab6-ea, col_values=(('qos', UUID('c5e86ce7-56f1-414b-bbc1-1177d41224f5')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e335ab6-ea, col_values=(('external_ids', {'iface-id': '4e335ab6-ea34-4dcd-bcba-305388ca6f81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:89:51', 'vm-uuid': '55940268-4985-49a7-8e4d-baa0051122cf'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:39 user nova-compute[75205]: INFO os_vif [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:51,bridge_name='br-int',has_traffic_filtering=True,id=4e335ab6-ea34-4dcd-bcba-305388ca6f81,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e335ab6-ea')
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:11:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] No VIF found with MAC fa:16:3e:eb:89:51, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG nova.network.neutron [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating instance_info_cache with network_info: [{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Releasing lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Instance destroyed successfully.
Nov 14 19:11:40 user nova-compute[75205]: DEBUG nova.objects.instance [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lazy-loading 'resources' on Instance uuid a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-12776011',display_name='tempest-TestShelveInstance-server-12776011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-12776011',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyH+B2L9vDS52XGIOFtQq8GpoMcT6XKkpN4qVH8KFroHuiUxYrcjFcY9smZubExjgKxjYqZYOi2P2yxFniSvEDm0BToHMxKwXbhhxdZEWS5bAjtVcp6fhFwddzwHUoFew==',key_name='tempest-TestShelveInstance-1819955855',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2b1f81e3e4a4ae3a9b7554997d170c1',ramdisk_id='',reservation_id='r-rm2y2t00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1961803319',owner_user_name='tempest-TestShelveInstance-1961803319-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:09:58Z,user_data=None,user_id='07cd34c968a9444a95fd601767385cfe',uuid=a3f91cd5-9ad2-49a0-9b53-4df71c63ff29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converting VIF {"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_vif [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd78d73b9-cc, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-f2736266-00c0-4961-8c54-27dc665fe499 req-73833991-3e91-45a9-9e95-d5fd5e324f13 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-changed-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-f2736266-00c0-4961-8c54-27dc665fe499 req-73833991-3e91-45a9-9e95-d5fd5e324f13 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Refreshing instance network info cache due to event network-changed-d78d73b9-cc60-4324-b5e4-2dede8700c73. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f2736266-00c0-4961-8c54-27dc665fe499 req-73833991-3e91-45a9-9e95-d5fd5e324f13 service nova] Acquiring lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f2736266-00c0-4961-8c54-27dc665fe499 req-73833991-3e91-45a9-9e95-d5fd5e324f13 service nova] Acquired lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG nova.network.neutron [req-f2736266-00c0-4961-8c54-27dc665fe499 req-73833991-3e91-45a9-9e95-d5fd5e324f13 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Refreshing network info cache for port d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1a71d36-df45-4b75-a83a-3b511c3b7172) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:40 user nova-compute[75205]: INFO os_vif [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc')
Nov 14 19:11:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbIWepfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:40 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3510524b-2eb3-46d8-bd00-da561f60b25e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:11:40 user nova-compute[75205]: No targets found.
Nov 14 19:11:40 user nova-compute[75205]: iSNS:
Nov 14 19:11:40 user nova-compute[75205]: No targets found.
Nov 14 19:11:40 user nova-compute[75205]: STATIC:
Nov 14 19:11:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:11:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:11:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76
Nov 14 19:11:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:11:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:11:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:11:40 user nova-compute[75205]: FIRMWARE:
Nov 14 19:11:40 user nova-compute[75205]: No targets found.
Nov 14 19:11:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:11:40 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:11:40 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5babf5-0174-4a31-8cf6-e15b16bde1bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ee6dcb-e65d-4308-b455-d8013582125a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:40 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:11:40 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:40 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:40 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:11:40 user nova-compute[75205]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:11:40 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7410b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651'): ({'sdf'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Removing single pathed devices sdf {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85ff2ea-83d0-43fa-8983-14f3c6b2a874]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0b50e7-ecb6-4ba2-b40f-32d210752012]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Flushing IO for device /dev/sdf {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.011s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[991fe1e1-5b79-4fb1-9079-be2befb19efe]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:11:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.061s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0652459-95c5-456b-96c8-9f90855eda23]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] SCSI volumes sdf have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de0bf2f-9e9d-4305-b36a-14d8750d591a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a012322-3ef2-42ec-8256-3623fde07cbd]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260]
Nov 14 19:11:41 user nova-compute[75205]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260] successful.
Nov 14 19:11:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aba0ad9-d6ec-4849-93bf-482981e69588]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] <== disconnect_volume: return (369ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:11:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Deleting instance files /opt/stack/data/nova/instances/a3f91cd5-9ad2-49a0-9b53-4df71c63ff29_del
Nov 14 19:11:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Deletion of /opt/stack/data/nova/instances/a3f91cd5-9ad2-49a0-9b53-4df71c63ff29_del complete
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.network.neutron [req-f2736266-00c0-4961-8c54-27dc665fe499 req-73833991-3e91-45a9-9e95-d5fd5e324f13 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updated VIF entry in instance network info cache for port d78d73b9-cc60-4324-b5e4-2dede8700c73. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.network.neutron [req-f2736266-00c0-4961-8c54-27dc665fe499 req-73833991-3e91-45a9-9e95-d5fd5e324f13 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating instance_info_cache with network_info: [{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": null, "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f2736266-00c0-4961-8c54-27dc665fe499 req-73833991-3e91-45a9-9e95-d5fd5e324f13 service nova] Releasing lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Received event network-changed-4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Refreshing instance network info cache due to event network-changed-4e335ab6-ea34-4dcd-bcba-305388ca6f81. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] Acquiring lock "refresh_cache-55940268-4985-49a7-8e4d-baa0051122cf" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] Acquired lock "refresh_cache-55940268-4985-49a7-8e4d-baa0051122cf" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.network.neutron [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Refreshing network info cache for port 4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-966bed82-90a4-469d-9eb9-ba852e7fda8b req-f00d9724-3d4b-4840-9d9a-d0b5475d84a9 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Received event network-vif-plugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-966bed82-90a4-469d-9eb9-ba852e7fda8b req-f00d9724-3d4b-4840-9d9a-d0b5475d84a9 service nova] Acquiring lock "55940268-4985-49a7-8e4d-baa0051122cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-966bed82-90a4-469d-9eb9-ba852e7fda8b req-f00d9724-3d4b-4840-9d9a-d0b5475d84a9 service nova] Lock "55940268-4985-49a7-8e4d-baa0051122cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-966bed82-90a4-469d-9eb9-ba852e7fda8b req-f00d9724-3d4b-4840-9d9a-d0b5475d84a9 service nova] Lock "55940268-4985-49a7-8e4d-baa0051122cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-966bed82-90a4-469d-9eb9-ba852e7fda8b req-f00d9724-3d4b-4840-9d9a-d0b5475d84a9 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] No waiting events found dispatching network-vif-plugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:41 user nova-compute[75205]: WARNING nova.compute.manager [req-966bed82-90a4-469d-9eb9-ba852e7fda8b req-f00d9724-3d4b-4840-9d9a-d0b5475d84a9 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Received unexpected event network-vif-plugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 for instance with vm_state building and task_state spawning.
Nov 14 19:11:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.network.neutron [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Updated VIF entry in instance network info cache for port 4e335ab6-ea34-4dcd-bcba-305388ca6f81. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.network.neutron [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Updating instance_info_cache with network_info: [{"id": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "address": "fa:16:3e:eb:89:51", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e335ab6-ea", "ovs_interfaceid": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] Releasing lock "refresh_cache-55940268-4985-49a7-8e4d-baa0051122cf" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] No waiting events found dispatching network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:41 user nova-compute[75205]: WARNING nova.compute.manager [req-0c60d042-c128-4b0f-89a1-41f851642ae6 req-561a9cfa-523e-4548-8ba8-b92092b42088 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received unexpected event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 for instance with vm_state active and task_state shelving.
Nov 14 19:11:42 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Deleted allocations for instance a3f91cd5-9ad2-49a0-9b53-4df71c63ff29
Nov 14 19:11:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:42 user nova-compute[75205]: DEBUG nova.objects.instance [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lazy-loading 'numa_topology' on Instance uuid a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:42 user nova-compute[75205]: DEBUG nova.objects.base [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Object Instance<a3f91cd5-9ad2-49a0-9b53-4df71c63ff29> lazy-loaded attributes: resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:11:42 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:11:42 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:11:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-06a3a77b-0c9d-422c-afde-37c9db919a40 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.026s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:11:43 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Instance spawned successfully.
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:11:43 user nova-compute[75205]: INFO nova.compute.manager [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-134f8610-c96a-4596-b40c-de24deef0c2e req-39a0261b-2085-49e6-92a6-362c4c73c442 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Received event network-vif-plugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-134f8610-c96a-4596-b40c-de24deef0c2e req-39a0261b-2085-49e6-92a6-362c4c73c442 service nova] Acquiring lock "55940268-4985-49a7-8e4d-baa0051122cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-134f8610-c96a-4596-b40c-de24deef0c2e req-39a0261b-2085-49e6-92a6-362c4c73c442 service nova] Lock "55940268-4985-49a7-8e4d-baa0051122cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-134f8610-c96a-4596-b40c-de24deef0c2e req-39a0261b-2085-49e6-92a6-362c4c73c442 service nova] Lock "55940268-4985-49a7-8e4d-baa0051122cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-134f8610-c96a-4596-b40c-de24deef0c2e req-39a0261b-2085-49e6-92a6-362c4c73c442 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] No waiting events found dispatching network-vif-plugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:43 user nova-compute[75205]: WARNING nova.compute.manager [req-134f8610-c96a-4596-b40c-de24deef0c2e req-39a0261b-2085-49e6-92a6-362c4c73c442 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Received unexpected event network-vif-plugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 for instance with vm_state building and task_state spawning.
Nov 14 19:11:43 user nova-compute[75205]: INFO nova.compute.manager [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Took 7.05 seconds to build instance.
Nov 14 19:11:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a52cd5c6-8693-4714-8274-3072a1f5f904 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "55940268-4985-49a7-8e4d-baa0051122cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.136s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:11:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:44 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:11:44 user nova-compute[75205]: INFO nova.compute.claims [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Claim successful on node user
Nov 14 19:11:44 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:11:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:11:45 user nova-compute[75205]: INFO nova.virt.block_device [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Booting with volume 002a42fd-27a3-45f1-af37-42ab1b8321e1 at /dev/vda
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.policy [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a5796455b0d47b5afd1738e2fb099af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852c4de81a8466882905f1c6801f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG os_brick.utils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2a678b-c67b-48c9-a264-87e2acb442fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd17ecd-ada9-401b-96c0-444cad9fa989]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[175c560e-a9b9-4600-9d75-9a5c60ae6260]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc55520-7cc6-4002-a41d-2be4193c2951]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:45 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[237fcf89-aae0-4a53-b4a6-4fdf64c374f6]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG os_brick.utils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating existing volume attachment record: 75ec2d19-ce87-47df-a88d-e17de5149165 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-628e2693-2481-4297-a3ea-b03fc40a5bbc req-8c7f2110-9f86-48e3-9c7e-6e6a6701869c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received event network-changed-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-628e2693-2481-4297-a3ea-b03fc40a5bbc req-8c7f2110-9f86-48e3-9c7e-6e6a6701869c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Refreshing instance network info cache due to event network-changed-084929fe-e98b-437e-8bbd-4b3c0ec7d97a. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628e2693-2481-4297-a3ea-b03fc40a5bbc req-8c7f2110-9f86-48e3-9c7e-6e6a6701869c service nova] Acquiring lock "refresh_cache-26a6a013-500d-4502-a9f1-cffef3c4ba27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628e2693-2481-4297-a3ea-b03fc40a5bbc req-8c7f2110-9f86-48e3-9c7e-6e6a6701869c service nova] Acquired lock "refresh_cache-26a6a013-500d-4502-a9f1-cffef3c4ba27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.network.neutron [req-628e2693-2481-4297-a3ea-b03fc40a5bbc req-8c7f2110-9f86-48e3-9c7e-6e6a6701869c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Refreshing network info cache for port 084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:45 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully created port: fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Acquiring lock "aa9e5564-b68f-42b4-9263-709641bde28b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "aa9e5564-b68f-42b4-9263-709641bde28b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Acquiring lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:46 user nova-compute[75205]: INFO nova.compute.manager [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Terminating instance
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-c398c4dd-a4f1-4b6f-8c93-a4e7003652c4 req-8cd276ac-e224-458f-96c5-b909e2c15c2f service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received event network-vif-unplugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c398c4dd-a4f1-4b6f-8c93-a4e7003652c4 req-8cd276ac-e224-458f-96c5-b909e2c15c2f service nova] Acquiring lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c398c4dd-a4f1-4b6f-8c93-a4e7003652c4 req-8cd276ac-e224-458f-96c5-b909e2c15c2f service nova] Lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c398c4dd-a4f1-4b6f-8c93-a4e7003652c4 req-8cd276ac-e224-458f-96c5-b909e2c15c2f service nova] Lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-c398c4dd-a4f1-4b6f-8c93-a4e7003652c4 req-8cd276ac-e224-458f-96c5-b909e2c15c2f service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] No waiting events found dispatching network-vif-unplugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-c398c4dd-a4f1-4b6f-8c93-a4e7003652c4 req-8cd276ac-e224-458f-96c5-b909e2c15c2f service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received event network-vif-unplugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.network.neutron [req-628e2693-2481-4297-a3ea-b03fc40a5bbc req-8c7f2110-9f86-48e3-9c7e-6e6a6701869c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Updated VIF entry in instance network info cache for port 084929fe-e98b-437e-8bbd-4b3c0ec7d97a. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.network.neutron [req-628e2693-2481-4297-a3ea-b03fc40a5bbc req-8c7f2110-9f86-48e3-9c7e-6e6a6701869c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Updating instance_info_cache with network_info: [{"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-628e2693-2481-4297-a3ea-b03fc40a5bbc req-8c7f2110-9f86-48e3-9c7e-6e6a6701869c service nova] Releasing lock "refresh_cache-26a6a013-500d-4502-a9f1-cffef3c4ba27" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully created port: 60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.objects.instance [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lazy-loading 'flavor' on Instance uuid 26a6a013-500d-4502-a9f1-cffef3c4ba27 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Instance destroyed successfully.
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.objects.instance [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lazy-loading 'resources' on Instance uuid aa9e5564-b68f-42b4-9263-709641bde28b {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2080709883',display_name='tempest-VolumesAssistedSnapshotsTest-server-2080709883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2080709883',id=7,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf3MD4sZUc3DxejQIVaPEkXUPv1HVIWYWzNVdK9vVrbHoLIpqRRkKZTQrris16fx1aUu46nsG0BUFxSl+KYxowCiwgrC8coY3lOCbLb92y5NI+0FAFkzqzc5HbIPQR3hQ==',key_name='tempest-keypair-973369489',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c674c3d5fd3405b950d59ecd4372b39',ramdisk_id='',reservation_id='r-ppnbjp6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-553621658',owner_user_name='tempest-VolumesAssistedSnapshotsTest-553621658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:09:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2990f8f4a3a44eeb269b6ab8519c28c',uuid=aa9e5564-b68f-42b4-9263-709641bde28b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Converting VIF {"id": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "address": "fa:16:3e:3d:d7:72", "network": {"id": "bff6b6cf-9b2d-4c94-aebc-1c191dd03017", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1751700670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c674c3d5fd3405b950d59ecd4372b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb67c8-84", "ovs_interfaceid": "70eb67c8-84ca-42ce-b702-4699cdbc0dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:d7:72,bridge_name='br-int',has_traffic_filtering=True,id=70eb67c8-84ca-42ce-b702-4699cdbc0dbb,network=Network(bff6b6cf-9b2d-4c94-aebc-1c191dd03017),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb67c8-84') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG os_vif [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:d7:72,bridge_name='br-int',has_traffic_filtering=True,id=70eb67c8-84ca-42ce-b702-4699cdbc0dbb,network=Network(bff6b6cf-9b2d-4c94-aebc-1c191dd03017),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb67c8-84') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70eb67c8-84, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59e21ab4-ae61-4a4b-ae93-cba3afe5a0c5) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:46 user nova-compute[75205]: INFO os_vif [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:d7:72,bridge_name='br-int',has_traffic_filtering=True,id=70eb67c8-84ca-42ce-b702-4699cdbc0dbb,network=Network(bff6b6cf-9b2d-4c94-aebc-1c191dd03017),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb67c8-84')
Nov 14 19:11:46 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Deleting instance files /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b_del
Nov 14 19:11:46 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Deletion of /opt/stack/data/nova/instances/aa9e5564-b68f-42b4-9263-709641bde28b_del complete
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:47 user nova-compute[75205]: INFO nova.compute.manager [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Attaching volume 9979d2e2-8b97-48fd-88e2-bbc61211ec70 to /dev/vdb
Nov 14 19:11:47 user nova-compute[75205]: INFO nova.compute.manager [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG os_brick.utils [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1143eff-ca7e-4c68-8d3a-4bf9c88ba255]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[311963c9-bd19-41e2-8964-e5149e98adce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d158a31c-0edd-42e2-9984-be260e966a84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca58e0-baf2-46ef-897f-118957101dbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:47 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:11:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e400f377-bd5c-4811-bcb2-b9a92569fb4b]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG os_brick.utils [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Updating existing volume attachment record: 9d947cc6-0ad8-4792-86fe-d477069493c4 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully created port: 368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:11:47 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully created port: ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-0b966fc6-0e6e-419c-af13-98a3dd0f1583 req-7ad366e6-52f3-4e00-b85a-73408ccd97cf service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received event network-vif-deleted-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:48 user nova-compute[75205]: INFO nova.compute.manager [req-0b966fc6-0e6e-419c-af13-98a3dd0f1583 req-7ad366e6-52f3-4e00-b85a-73408ccd97cf service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Neutron deleted interface 70eb67c8-84ca-42ce-b702-4699cdbc0dbb; detaching it from the instance and deleting it from the info cache
Nov 14 19:11:48 user nova-compute[75205]: DEBUG nova.network.neutron [req-0b966fc6-0e6e-419c-af13-98a3dd0f1583 req-7ad366e6-52f3-4e00-b85a-73408ccd97cf service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:48 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Took 0.96 seconds to deallocate network for instance.
Nov 14 19:11:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-0b966fc6-0e6e-419c-af13-98a3dd0f1583 req-7ad366e6-52f3-4e00-b85a-73408ccd97cf service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Detach interface failed, port_id=70eb67c8-84ca-42ce-b702-4699cdbc0dbb, reason: Instance aa9e5564-b68f-42b4-9263-709641bde28b could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully created port: 04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-9d66d76c-3305-47f5-9ee7-09a35a65cc4b req-beb0a6b3-47e0-4890-9696-0df3455f9f72 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received event network-vif-plugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9d66d76c-3305-47f5-9ee7-09a35a65cc4b req-beb0a6b3-47e0-4890-9696-0df3455f9f72 service nova] Acquiring lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9d66d76c-3305-47f5-9ee7-09a35a65cc4b req-beb0a6b3-47e0-4890-9696-0df3455f9f72 service nova] Lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9d66d76c-3305-47f5-9ee7-09a35a65cc4b req-beb0a6b3-47e0-4890-9696-0df3455f9f72 service nova] Lock "aa9e5564-b68f-42b4-9263-709641bde28b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-9d66d76c-3305-47f5-9ee7-09a35a65cc4b req-beb0a6b3-47e0-4890-9696-0df3455f9f72 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] No waiting events found dispatching network-vif-plugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:11:48 user nova-compute[75205]: WARNING nova.compute.manager [req-9d66d76c-3305-47f5-9ee7-09a35a65cc4b req-beb0a6b3-47e0-4890-9696-0df3455f9f72 service nova] [instance: aa9e5564-b68f-42b4-9263-709641bde28b] Received unexpected event network-vif-plugged-70eb67c8-84ca-42ce-b702-4699cdbc0dbb for instance with vm_state deleted and task_state None.
Nov 14 19:11:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:48 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Deleted allocations for instance aa9e5564-b68f-42b4-9263-709641bde28b
Nov 14 19:11:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-058a716a-5408-414f-9d2e-4769f9733473 tempest-VolumesAssistedSnapshotsTest-553621658 tempest-VolumesAssistedSnapshotsTest-553621658-project-member] Lock "aa9e5564-b68f-42b4-9263-709641bde28b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.568s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:49 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully updated port: fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully updated port: 3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:11:50 user nova-compute[75205]: INFO nova.virt.block_device [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Booting with volume 75f0cda0-d13e-4f97-be7d-c3e12a58731e at /dev/vdb
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully updated port: abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.compute.manager [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-changed-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.compute.manager [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing instance network info cache due to event network-changed-fd4dab88-47b5-4558-a23d-dfa94e2ad64c. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] Acquiring lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] Acquired lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.network.neutron [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing network info cache for port fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG os_brick.utils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[28179977-25b8-42e2-ba62-446a02b571aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42c993b-c8f5-44de-a677-e3473cb8399f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1288123-ecb5-4b8c-93c1-7359b493a97e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb4f412-c5f1-40d6-8d74-26cfe5e3e5cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.network.neutron [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:50 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3265efb2-5dfd-49a2-8b85-fe22365d90b2]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG os_brick.utils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating existing volume attachment record: 4686c31a-fbe0-41a5-9320-ddf69f4cfde8 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.network.neutron [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] Releasing lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.compute.manager [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-changed-3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.compute.manager [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing instance network info cache due to event network-changed-3a669c43-3923-4432-ab6a-466136662357. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] Acquiring lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] Acquired lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:50 user nova-compute[75205]: DEBUG nova.network.neutron [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing network info cache for port 3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:51 user nova-compute[75205]: DEBUG nova.network.neutron [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:11:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully updated port: 60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:11:51 user nova-compute[75205]: DEBUG nova.network.neutron [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0f2b5c35-3c64-4109-ba47-e4bad7be900d req-75ceff3c-d982-4b19-bd57-c14ea569b750 service nova] Releasing lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully updated port: 368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:11:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWGxbIFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:52 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:52 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:11:52 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae3a31e-0842-41dc-bd9c-beb23219678d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:11:52 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c51858-6977-43b1-9a82-9dd4990c280a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70] added
Nov 14 19:11:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[192f9687-d771-4dea-9178-230682944be8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff78796-a623-4ff8-a252-7c199973a909]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully updated port: ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWGxbIFV {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWGxbIFV" returned: 0 in 0.049s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca6a033-f1f6-4208-bc53-8e12ff0a8f6a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RWGxbIFV'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[82027684-6285-445e-b6bf-4537e78e11eb]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a60052-c9bf-4ac8-af19-6b2f614d7a36]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f548b98-c7c7-4e8f-9a73-54fb30c35608]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70, portal: 172.16.0.220,3260]
Nov 14 19:11:52 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70, portal: 172.16.0.220,3260] successful.
Nov 14 19:11:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1defa555-1228-4db1-8195-5762a874cb6a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3caad2b-8492-4816-9874-969ee9b94f97]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:11:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[466fb08d-33bc-4cab-833f-95790d12d97c]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWGxbIFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG nova.compute.manager [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-changed-abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG nova.compute.manager [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing instance network info cache due to event network-changed-abe87def-a869-4cb5-8d72-3f231507f40e. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Acquiring lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Acquired lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing network info cache for port abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:11:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Releasing lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-changed-60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing instance network info cache due to event network-changed-60da9c54-607a-4873-94fd-e2d42286a938. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Acquiring lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Acquired lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing network info cache for port 60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Successfully updated port: 04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Releasing lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-changed-368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing instance network info cache due to event network-changed-368d010b-d5d4-4c97-9fba-58a6a3ae869d. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Acquiring lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Acquired lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing network info cache for port 368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Releasing lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-changed-ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing instance network info cache due to event network-changed-ee97e4ba-8b52-478f-95fa-378821a4fd4c. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Acquiring lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Acquired lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing network info cache for port ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26338363463396633', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338363463396633', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lazy-loading 'flavor' on Instance uuid 26a6a013-500d-4502-a9f1-cffef3c4ba27 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:11:53 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:11:53 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:11:53 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:11:53 user nova-compute[75205]:   <serial>9979d2e2-8b97-48fd-88e2-bbc61211ec70</serial>
Nov 14 19:11:53 user nova-compute[75205]: </disk>
Nov 14 19:11:53 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8fab879c-e483-4931-9c2b-1802efeb8de3 req-f743876f-c88c-499b-a11a-1fd5b7bba176 service nova] Releasing lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquired lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:11:53 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:11:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:11:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:11:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] No VIF found with MAC fa:16:3e:e3:cb:d7, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:11:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-81a1c9e0-9fab-4ad7-bf11-f1a08866be38 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.069s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:11:54 user nova-compute[75205]: DEBUG nova.compute.manager [req-3b3a6144-564d-4795-9269-34c4f7f52ff9 req-58936979-2508-4c81-981b-830c23ebb174 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-changed-04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:11:54 user nova-compute[75205]: DEBUG nova.compute.manager [req-3b3a6144-564d-4795-9269-34c4f7f52ff9 req-58936979-2508-4c81-981b-830c23ebb174 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing instance network info cache due to event network-changed-04afe31a-5ddd-475b-a353-9465641b535f. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:11:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3b3a6144-564d-4795-9269-34c4f7f52ff9 req-58936979-2508-4c81-981b-830c23ebb174 service nova] Acquiring lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:11:55 user nova-compute[75205]: INFO nova.virt.block_device [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Booting with volume c186fef0-f43c-4707-bc10-4863dc815759 at /dev/vdc
Nov 14 19:11:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [{"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG os_brick.utils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[64162e8c-13bf-4369-9351-f85a66b191d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Releasing lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance network_info: |[{"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3b3a6144-564d-4795-9269-34c4f7f52ff9 req-58936979-2508-4c81-981b-830c23ebb174 service nova] Acquired lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG nova.network.neutron [req-3b3a6144-564d-4795-9269-34c4f7f52ff9 req-58936979-2508-4c81-981b-830c23ebb174 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing network info cache for port 04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[77587bcd-e248-4abe-b8d4-337ffbba7f0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2970e027-bce1-4b81-a712-c6927f28a8b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3f64d0-2df0-4227-abd9-fe2a3276c913]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:11:56 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:11:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6068507b-67ec-4fe7-bd50-6f943ad5c002]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG os_brick.utils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating existing volume attachment record: 35e5483c-dc65-40de-bcf4-40a11ec014d3 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:11:56 user nova-compute[75205]: INFO nova.compute.manager [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Detaching volume 9979d2e2-8b97-48fd-88e2-bbc61211ec70
Nov 14 19:11:56 user nova-compute[75205]: INFO nova.virt.block_device [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Attempting to driver detach volume 9979d2e2-8b97-48fd-88e2-bbc61211ec70 from mountpoint /dev/vdb
Nov 14 19:11:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Attempting to detach device vdb from instance 26a6a013-500d-4502-a9f1-cffef3c4ba27 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:11:56 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:11:56 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:11:56 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:11:56 user nova-compute[75205]:   <serial>9979d2e2-8b97-48fd-88e2-bbc61211ec70</serial>
Nov 14 19:11:56 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:11:56 user nova-compute[75205]: </disk>
Nov 14 19:11:56 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:11:56 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Successfully detached device vdb from instance 26a6a013-500d-4502-a9f1-cffef3c4ba27 from the persistent domain config.
Nov 14 19:11:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 26a6a013-500d-4502-a9f1-cffef3c4ba27 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:11:56 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:11:56 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:11:56 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:11:56 user nova-compute[75205]:   <serial>9979d2e2-8b97-48fd-88e2-bbc61211ec70</serial>
Nov 14 19:11:56 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:11:56 user nova-compute[75205]: </disk>
Nov 14 19:11:56 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG nova.network.neutron [req-3b3a6144-564d-4795-9269-34c4f7f52ff9 req-58936979-2508-4c81-981b-830c23ebb174 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updated VIF entry in instance network info cache for port 04afe31a-5ddd-475b-a353-9465641b535f. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG nova.network.neutron [req-3b3a6144-564d-4795-9269-34c4f7f52ff9 req-58936979-2508-4c81-981b-830c23ebb174 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [{"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3b3a6144-564d-4795-9269-34c4f7f52ff9 req-58936979-2508-4c81-981b-830c23ebb174 service nova] Releasing lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 26a6a013-500d-4502-a9f1-cffef3c4ba27 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:11:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:12:00 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Creating image(s)
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Ensure instance console log exists: /opt/stack/data/nova/instances/34cf679a-1aa5-453a-abca-9db47cf798ef/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Start _get_guest_xml network_info=[{"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BWCuazJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34cf679a-1aa5-453a-abca-9db47cf798ef', 'attached_at': '', 'detached_at': '', 'volume_id': '002a42fd-27a3-45f1-af37-42ab1b8321e1', 'serial': '002a42fd-27a3-45f1-af37-42ab1b8321e1'}, 'attachment_id': '75ec2d19-ce87-47df-a88d-e17de5149165', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None}, {'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psCLaZGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34cf679a-1aa5-453a-abca-9db47cf798ef', 'attached_at': '', 'detached_at': '', 'volume_id': '75f0cda0-d13e-4f97-be7d-c3e12a58731e', 'serial': '75f0cda0-d13e-4f97-be7d-c3e12a58731e'}, 'attachment_id': '4686c31a-fbe0-41a5-9320-ddf69f4cfde8', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'volume_type': None}, {'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVAhGfxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34cf679a-1aa5-453a-abca-9db47cf798ef', 'attached_at': '', 'detached_at': '', 'volume_id': 'c186fef0-f43c-4707-bc10-4863dc815759', 'serial': 'c186fef0-f43c-4707-bc10-4863dc815759'}, 'attachment_id': '35e5483c-dc65-40de-bcf4-40a11ec014d3', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:12:00 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:12:00 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BWCuazJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:12:00 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:00 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:00 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c56cdb4-f840-4696-9913-7ecdcb1721a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:12:00 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70db71b-b801-4ed1-9649-ebeb8ba7fe4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1] added
Nov 14 19:12:00 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[18927ade-1208-4ca7-b746-fdd55908c38d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1f4af9-f982-47a7-b2d5-630ee02616cc]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BWCuazJb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BWCuazJb" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2656b1ff-d6a5-46e8-9824-5da41adbfa57]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BWCuazJb'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d06b0e-97fe-42ab-bf46-3f652f4d0f18]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebefa8c2-6f16-4220-901a-dcd7935f5a4d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:00 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:00 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:00 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:00 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:00 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:00 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:00 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:00 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e712cab-af61-4318-bd2e-c0d0374c5fcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1, portal: 172.16.0.220,3260]
Nov 14 19:12:01 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1, portal: 172.16.0.220,3260] successful.
Nov 14 19:12:01 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[248151f5-c1f8-44b4-a344-c0437a5af29d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ba2dc7-e9c6-4d1a-a561-4e9d7d42e00d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:01 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:01 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:01 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:01 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:01 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:01 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:01 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:01 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:01 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:01 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cd7429-46e7-4f10-8287-931dcf4f5ad7]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BWCuazJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26565356666656530', 'path': '/dev/sde'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565356666656530', 'path': '/dev/sde'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psCLaZGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:12:02 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:02 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:02 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebba651d-8c99-46b7-8f51-53719a710cf6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:12:02 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[521090fd-b5e8-4cbc-ba25-d03d17dfe4ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e] added
Nov 14 19:12:02 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c3cc34-89ed-45f0-9251-8dfccf7942ee]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1024b8-92e7-47f0-8990-6d6eac122cb8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psCLaZGw {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psCLaZGw" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5560678-2f47-4c59-886c-9c46cacd4e66]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psCLaZGw'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cecc04f-e1b1-40eb-a02b-21ab2db33f52]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dc7723-a0b6-4a4f-9cd0-8e5c0089a146]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[51592b8b-d4d0-4e3c-8e41-3d63c3984f85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e, portal: 172.16.0.220,3260]
Nov 14 19:12:02 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e, portal: 172.16.0.220,3260] successful.
Nov 14 19:12:02 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[05625670-1d0b-44ec-ba58-2c537c9764de]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128ea78-6b7e-443f-bc70-1ed4ce37aeec]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:02 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:02 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[29383db8-e09e-4f83-853c-e90eac5f64fc]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:12:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psCLaZGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26566396331396230', 'path': '/dev/sdf'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566396331396230', 'path': '/dev/sdf'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVAhGfxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:12:03 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:03 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:03 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7be9ba-520c-4577-b90e-413a4a530656]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:12:03 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1adf41-6803-46b4-ab9d-2125f82571f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759] added
Nov 14 19:12:03 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7973eb1-7608-467a-9781-78147378815d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f07238-f500-46ff-a14b-aa7c9a3f99db]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVAhGfxL {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVAhGfxL" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbbb946-9dba-432c-8b94-6146494a28e8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TVAhGfxL'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[842dbc80-9e63-44e0-b45a-0adac8406424]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5fca54-dc32-4a38-a6dc-77cac8fe6d4f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e325e428-496d-403f-a44e-1788a2eb50de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759, portal: 172.16.0.220,3260]
Nov 14 19:12:03 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759, portal: 172.16.0.220,3260] successful.
Nov 14 19:12:03 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d233ddd2-cc33-47aa-9046-e2b11a7568b6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[da589c9d-3bb2-4b80-be9b-a531214ebbb3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:03 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8d4eab-7656-4c38-a99e-3fc26a694ac5]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:03 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:04 user nova-compute[75205]: INFO nova.compute.manager [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Terminating instance
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-600995ea-1310-43ba-80a4-1cf7e5ac2f8a req-70dbbf28-858d-4a4b-959a-f876e8eeb8a4 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-unplugged-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-600995ea-1310-43ba-80a4-1cf7e5ac2f8a req-70dbbf28-858d-4a4b-959a-f876e8eeb8a4 service nova] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-600995ea-1310-43ba-80a4-1cf7e5ac2f8a req-70dbbf28-858d-4a4b-959a-f876e8eeb8a4 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-600995ea-1310-43ba-80a4-1cf7e5ac2f8a req-70dbbf28-858d-4a4b-959a-f876e8eeb8a4 service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-600995ea-1310-43ba-80a4-1cf7e5ac2f8a req-70dbbf28-858d-4a4b-959a-f876e8eeb8a4 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] No waiting events found dispatching network-vif-unplugged-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-600995ea-1310-43ba-80a4-1cf7e5ac2f8a req-70dbbf28-858d-4a4b-959a-f876e8eeb8a4 service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-unplugged-56984858-000b-45d7-a6f0-13dc113e14f6 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVAhGfxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23831373839306234', 'path': '/dev/sdh'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831373839306234', 'path': '/dev/sdh'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:6c:98,bridge_name='br-int',has_traffic_filtering=True,id=fd4dab88-47b5-4558-a23d-dfa94e2ad64c,network=Network(1be41a27-3a73-4057-9917-def756e20cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4dab88-47') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=3a669c43-3923-4432-ab6a-466136662357,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a669c43-39') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c8:23,bridge_name='br-int',has_traffic_filtering=True,id=abe87def-a869-4cb5-8d72-3f231507f40e,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabe87def-a8') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:f8,bridge_name='br-int',has_traffic_filtering=True,id=60da9c54-607a-4873-94fd-e2d42286a938,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da9c54-60') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:e5,bridge_name='br-int',has_traffic_filtering=True,id=368d010b-d5d4-4c97-9fba-58a6a3ae869d,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368d010b-d5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:db:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee97e4ba-8b52-478f-95fa-378821a4fd4c,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97e4ba-8b') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=04afe31a-5ddd-475b-a353-9465641b535f,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04afe31a-5d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lazy-loading 'pci_devices' on Instance uuid 34cf679a-1aa5-453a-abca-9db47cf798ef {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:12:04 user nova-compute[75205]:   <uuid>34cf679a-1aa5-453a-abca-9db47cf798ef</uuid>
Nov 14 19:12:04 user nova-compute[75205]:   <name>instance-0000000f</name>
Nov 14 19:12:04 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:12:04 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:12:04 user nova-compute[75205]:   <metadata>
Nov 14 19:12:04 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:12:04 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:12:04 user nova-compute[75205]:       <nova:name>tempest-device-tagging-server-2130674706</nova:name>
Nov 14 19:12:04 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:12:00</nova:creationTime>
Nov 14 19:12:04 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:12:04 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:12:04 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:12:04 user nova-compute[75205]:       <nova:owner>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:user uuid="6a5796455b0d47b5afd1738e2fb099af">tempest-TaggedBootDevicesTest-323420199-project-member</nova:user>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:project uuid="b852c4de81a8466882905f1c6801f0cf">tempest-TaggedBootDevicesTest-323420199</nova:project>
Nov 14 19:12:04 user nova-compute[75205]:       </nova:owner>
Nov 14 19:12:04 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:12:04 user nova-compute[75205]:       <nova:ports>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:port uuid="fd4dab88-47b5-4558-a23d-dfa94e2ad64c">
Nov 14 19:12:04 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 19:12:04 user nova-compute[75205]:         </nova:port>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:port uuid="3a669c43-3923-4432-ab6a-466136662357">
Nov 14 19:12:04 user nova-compute[75205]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Nov 14 19:12:04 user nova-compute[75205]:         </nova:port>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:port uuid="abe87def-a869-4cb5-8d72-3f231507f40e">
Nov 14 19:12:04 user nova-compute[75205]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Nov 14 19:12:04 user nova-compute[75205]:         </nova:port>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:port uuid="60da9c54-607a-4873-94fd-e2d42286a938">
Nov 14 19:12:04 user nova-compute[75205]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Nov 14 19:12:04 user nova-compute[75205]:         </nova:port>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:port uuid="368d010b-d5d4-4c97-9fba-58a6a3ae869d">
Nov 14 19:12:04 user nova-compute[75205]:           <nova:ip type="fixed" address="10.1.1.128" ipVersion="4"/>
Nov 14 19:12:04 user nova-compute[75205]:         </nova:port>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:port uuid="ee97e4ba-8b52-478f-95fa-378821a4fd4c">
Nov 14 19:12:04 user nova-compute[75205]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 19:12:04 user nova-compute[75205]:         </nova:port>
Nov 14 19:12:04 user nova-compute[75205]:         <nova:port uuid="04afe31a-5ddd-475b-a353-9465641b535f">
Nov 14 19:12:04 user nova-compute[75205]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 19:12:04 user nova-compute[75205]:         </nova:port>
Nov 14 19:12:04 user nova-compute[75205]:       </nova:ports>
Nov 14 19:12:04 user nova-compute[75205]:     </nova:instance>
Nov 14 19:12:04 user nova-compute[75205]:   </metadata>
Nov 14 19:12:04 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:12:04 user nova-compute[75205]:     <system>
Nov 14 19:12:04 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:12:04 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:12:04 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:12:04 user nova-compute[75205]:       <entry name="serial">34cf679a-1aa5-453a-abca-9db47cf798ef</entry>
Nov 14 19:12:04 user nova-compute[75205]:       <entry name="uuid">34cf679a-1aa5-453a-abca-9db47cf798ef</entry>
Nov 14 19:12:04 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:12:04 user nova-compute[75205]:     </system>
Nov 14 19:12:04 user nova-compute[75205]:   </sysinfo>
Nov 14 19:12:04 user nova-compute[75205]:   <os>
Nov 14 19:12:04 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:12:04 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:12:04 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:12:04 user nova-compute[75205]:   </os>
Nov 14 19:12:04 user nova-compute[75205]:   <features>
Nov 14 19:12:04 user nova-compute[75205]:     <acpi/>
Nov 14 19:12:04 user nova-compute[75205]:     <apic/>
Nov 14 19:12:04 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:12:04 user nova-compute[75205]:   </features>
Nov 14 19:12:04 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:12:04 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:12:04 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:12:04 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:12:04 user nova-compute[75205]:   </clock>
Nov 14 19:12:04 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:12:04 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:12:04 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:12:04 user nova-compute[75205]:   </cpu>
Nov 14 19:12:04 user nova-compute[75205]:   <devices>
Nov 14 19:12:04 user nova-compute[75205]:     <disk type="file" device="cdrom">
Nov 14 19:12:04 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 19:12:04 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/34cf679a-1aa5-453a-abca-9db47cf798ef/disk.config"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="hda" bus="ide"/>
Nov 14 19:12:04 user nova-compute[75205]:     </disk>
Nov 14 19:12:04 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:12:04 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:12:04 user nova-compute[75205]:       <source dev="/dev/sde"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:       <serial>002a42fd-27a3-45f1-af37-42ab1b8321e1</serial>
Nov 14 19:12:04 user nova-compute[75205]:     </disk>
Nov 14 19:12:04 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:12:04 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:12:04 user nova-compute[75205]:       <source dev="/dev/sdf"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:       <serial>75f0cda0-d13e-4f97-be7d-c3e12a58731e</serial>
Nov 14 19:12:04 user nova-compute[75205]:     </disk>
Nov 14 19:12:04 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:12:04 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:12:04 user nova-compute[75205]:       <source dev="/dev/sdh"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="vdc" bus="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:       <serial>c186fef0-f43c-4707-bc10-4863dc815759</serial>
Nov 14 19:12:04 user nova-compute[75205]:     </disk>
Nov 14 19:12:04 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:12:04 user nova-compute[75205]:       <mac address="fa:16:3e:d5:6c:98"/>
Nov 14 19:12:04 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="tapfd4dab88-47"/>
Nov 14 19:12:04 user nova-compute[75205]:     </interface>
Nov 14 19:12:04 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:12:04 user nova-compute[75205]:       <mac address="fa:16:3e:ca:77:5c"/>
Nov 14 19:12:04 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="tap3a669c43-39"/>
Nov 14 19:12:04 user nova-compute[75205]:     </interface>
Nov 14 19:12:04 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:12:04 user nova-compute[75205]:       <mac address="fa:16:3e:e4:c8:23"/>
Nov 14 19:12:04 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="tapabe87def-a8"/>
Nov 14 19:12:04 user nova-compute[75205]:     </interface>
Nov 14 19:12:04 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:12:04 user nova-compute[75205]:       <mac address="fa:16:3e:a8:9a:f8"/>
Nov 14 19:12:04 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="tap60da9c54-60"/>
Nov 14 19:12:04 user nova-compute[75205]:     </interface>
Nov 14 19:12:04 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:12:04 user nova-compute[75205]:       <mac address="fa:16:3e:15:20:e5"/>
Nov 14 19:12:04 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="tap368d010b-d5"/>
Nov 14 19:12:04 user nova-compute[75205]:     </interface>
Nov 14 19:12:04 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:12:04 user nova-compute[75205]:       <mac address="fa:16:3e:7f:db:0a"/>
Nov 14 19:12:04 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="tapee97e4ba-8b"/>
Nov 14 19:12:04 user nova-compute[75205]:     </interface>
Nov 14 19:12:04 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:12:04 user nova-compute[75205]:       <mac address="fa:16:3e:78:2a:c6"/>
Nov 14 19:12:04 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:12:04 user nova-compute[75205]:       <target dev="tap04afe31a-5d"/>
Nov 14 19:12:04 user nova-compute[75205]:     </interface>
Nov 14 19:12:04 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:12:04 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/34cf679a-1aa5-453a-abca-9db47cf798ef/console.log" append="off"/>
Nov 14 19:12:04 user nova-compute[75205]:     </serial>
Nov 14 19:12:04 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:12:04 user nova-compute[75205]:     <video>
Nov 14 19:12:04 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:04 user nova-compute[75205]:     </video>
Nov 14 19:12:04 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:12:04 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:12:04 user nova-compute[75205]:     </rng>
Nov 14 19:12:04 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:12:04 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:12:04 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:12:04 user nova-compute[75205]:     </memballoon>
Nov 14 19:12:04 user nova-compute[75205]:   </devices>
Nov 14 19:12:04 user nova-compute[75205]: </domain>
Nov 14 19:12:04 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:6c:98,bridge_name='br-int',has_traffic_filtering=True,id=fd4dab88-47b5-4558-a23d-dfa94e2ad64c,network=Network(1be41a27-3a73-4057-9917-def756e20cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4dab88-47') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:6c:98,bridge_name='br-int',has_traffic_filtering=True,id=fd4dab88-47b5-4558-a23d-dfa94e2ad64c,network=Network(1be41a27-3a73-4057-9917-def756e20cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4dab88-47') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98a977b1-d8cf-5e83-98c6-3391a4599044', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd4dab88-47, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd4dab88-47, col_values=(('qos', UUID('70272564-9e8c-458c-9080-5a964954a32e')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd4dab88-47, col_values=(('external_ids', {'iface-id': 'fd4dab88-47b5-4558-a23d-dfa94e2ad64c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:6c:98', 'vm-uuid': '34cf679a-1aa5-453a-abca-9db47cf798ef'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: INFO os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:6c:98,bridge_name='br-int',has_traffic_filtering=True,id=fd4dab88-47b5-4558-a23d-dfa94e2ad64c,network=Network(1be41a27-3a73-4057-9917-def756e20cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4dab88-47')
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=3a669c43-3923-4432-ab6a-466136662357,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a669c43-39') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=3a669c43-3923-4432-ab6a-466136662357,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a669c43-39') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2ca1117-dc59-56fe-abca-356226db8923', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a669c43-39, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a669c43-39, col_values=(('qos', UUID('9a11c78d-ef18-4e6a-bd81-326da74dce32')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a669c43-39, col_values=(('external_ids', {'iface-id': '3a669c43-3923-4432-ab6a-466136662357', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:77:5c', 'vm-uuid': '34cf679a-1aa5-453a-abca-9db47cf798ef'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: INFO os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=3a669c43-3923-4432-ab6a-466136662357,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a669c43-39')
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c8:23,bridge_name='br-int',has_traffic_filtering=True,id=abe87def-a869-4cb5-8d72-3f231507f40e,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabe87def-a8') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c8:23,bridge_name='br-int',has_traffic_filtering=True,id=abe87def-a869-4cb5-8d72-3f231507f40e,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabe87def-a8') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8266ba60-235a-5167-a606-98b62c00c087', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabe87def-a8, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabe87def-a8, col_values=(('qos', UUID('9b0bc1ae-c14d-4abc-af02-a3ced0eadac1')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabe87def-a8, col_values=(('external_ids', {'iface-id': 'abe87def-a869-4cb5-8d72-3f231507f40e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:c8:23', 'vm-uuid': '34cf679a-1aa5-453a-abca-9db47cf798ef'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: INFO os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c8:23,bridge_name='br-int',has_traffic_filtering=True,id=abe87def-a869-4cb5-8d72-3f231507f40e,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabe87def-a8')
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:f8,bridge_name='br-int',has_traffic_filtering=True,id=60da9c54-607a-4873-94fd-e2d42286a938,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da9c54-60') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:f8,bridge_name='br-int',has_traffic_filtering=True,id=60da9c54-607a-4873-94fd-e2d42286a938,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da9c54-60') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e07e63c3-fdd3-5ed8-b77f-6d304e98a985', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60da9c54-60, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60da9c54-60, col_values=(('qos', UUID('b49177ef-6d36-436d-b85b-be921824d84c')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60da9c54-60, col_values=(('external_ids', {'iface-id': '60da9c54-607a-4873-94fd-e2d42286a938', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:9a:f8', 'vm-uuid': '34cf679a-1aa5-453a-abca-9db47cf798ef'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Instance destroyed successfully.
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.objects.instance [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lazy-loading 'resources' on Instance uuid b2696233-b1c2-466d-92f1-0a30c3db1501 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923454376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923454376',id=6,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkRIwsBeDyQ11FuXQIwqoygHpHsgf3Cdt8fX3locV211FBgH9EBzW/BZRFfpB5sEUt5eCT8S2LhivMEVz8NcFsdFBPYZakdFldF/6rJgd/n1gME/tmQkgZpjcxprOgRtg==',key_name='tempest-keypair-1747689188',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11eaa2f5d6a94a368051677cc0d85b33',ramdisk_id='',reservation_id='r-nrqchh9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-551564993',owner_user_name='tempest-TaggedAttachmentsTest-551564993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65487f5c81204b0d86821d4a0eec289c',uuid=b2696233-b1c2-466d-92f1-0a30c3db1501,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converting VIF {"id": "56984858-000b-45d7-a6f0-13dc113e14f6", "address": "fa:16:3e:e0:1f:1e", "network": {"id": "154707de-2911-4f74-84b7-3b6c612d38e5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1739345080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11eaa2f5d6a94a368051677cc0d85b33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56984858-00", "ovs_interfaceid": "56984858-000b-45d7-a6f0-13dc113e14f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:1f:1e,bridge_name='br-int',has_traffic_filtering=True,id=56984858-000b-45d7-a6f0-13dc113e14f6,network=Network(154707de-2911-4f74-84b7-3b6c612d38e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56984858-00') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG os_vif [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:1f:1e,bridge_name='br-int',has_traffic_filtering=True,id=56984858-000b-45d7-a6f0-13dc113e14f6,network=Network(154707de-2911-4f74-84b7-3b6c612d38e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56984858-00') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: INFO os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:f8,bridge_name='br-int',has_traffic_filtering=True,id=60da9c54-607a-4873-94fd-e2d42286a938,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da9c54-60')
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:e5,bridge_name='br-int',has_traffic_filtering=True,id=368d010b-d5d4-4c97-9fba-58a6a3ae869d,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368d010b-d5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:e5,bridge_name='br-int',has_traffic_filtering=True,id=368d010b-d5d4-4c97-9fba-58a6a3ae869d,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368d010b-d5') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56984858-00, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=583a55d7-2e02-422c-a1ce-5b24d849c910) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70c3c1c9-93c6-5128-9d71-83bc6d80674a', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: INFO os_vif [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:1f:1e,bridge_name='br-int',has_traffic_filtering=True,id=56984858-000b-45d7-a6f0-13dc113e14f6,network=Network(154707de-2911-4f74-84b7-3b6c612d38e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56984858-00')
Nov 14 19:12:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Deleting instance files /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501_del
Nov 14 19:12:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Deletion of /opt/stack/data/nova/instances/b2696233-b1c2-466d-92f1-0a30c3db1501_del complete
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap368d010b-d5, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap368d010b-d5, col_values=(('qos', UUID('ebcd79d7-cdcd-45af-bf60-20a332d66715')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap368d010b-d5, col_values=(('external_ids', {'iface-id': '368d010b-d5d4-4c97-9fba-58a6a3ae869d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:20:e5', 'vm-uuid': '34cf679a-1aa5-453a-abca-9db47cf798ef'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: INFO nova.compute.manager [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 14 19:12:05 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: INFO os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:e5,bridge_name='br-int',has_traffic_filtering=True,id=368d010b-d5d4-4c97-9fba-58a6a3ae869d,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368d010b-d5')
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:db:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee97e4ba-8b52-478f-95fa-378821a4fd4c,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97e4ba-8b') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:db:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee97e4ba-8b52-478f-95fa-378821a4fd4c,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97e4ba-8b') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b60915eb-c3e7-572d-8b60-a7d0767d441e', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee97e4ba-8b, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee97e4ba-8b, col_values=(('qos', UUID('879d8078-2401-4264-adcb-90f5afd6859e')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee97e4ba-8b, col_values=(('external_ids', {'iface-id': 'ee97e4ba-8b52-478f-95fa-378821a4fd4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:db:0a', 'vm-uuid': '34cf679a-1aa5-453a-abca-9db47cf798ef'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: INFO os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:db:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee97e4ba-8b52-478f-95fa-378821a4fd4c,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97e4ba-8b')
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=04afe31a-5ddd-475b-a353-9465641b535f,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04afe31a-5d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=04afe31a-5ddd-475b-a353-9465641b535f,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04afe31a-5d') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fab3c79-6372-55b6-8fb2-fc3f8aed5ea1', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04afe31a-5d, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04afe31a-5d, col_values=(('qos', UUID('aa886fae-be28-46c9-bcfa-92212033ea4a')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04afe31a-5d, col_values=(('external_ids', {'iface-id': '04afe31a-5ddd-475b-a353-9465641b535f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:2a:c6', 'vm-uuid': '34cf679a-1aa5-453a-abca-9db47cf798ef'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:05 user nova-compute[75205]: INFO os_vif [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=04afe31a-5ddd-475b-a353-9465641b535f,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04afe31a-5d')
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] No BDM found with device name hda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] No VIF found with MAC fa:16:3e:d5:6c:98, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:12:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] No VIF found with MAC fa:16:3e:15:20:e5, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:12:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Using config drive
Nov 14 19:12:06 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Creating config drive at /opt/stack/data/nova/instances/34cf679a-1aa5-453a-abca-9db47cf798ef/disk.config
Nov 14 19:12:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/34cf679a-1aa5-453a-abca-9db47cf798ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuou7jxor {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/34cf679a-1aa5-453a-abca-9db47cf798ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuou7jxor" returned: 0 in 0.069s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:06 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Took 0.90 seconds to deallocate network for instance.
Nov 14 19:12:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:06 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Deleted allocations for instance b2696233-b1c2-466d-92f1-0a30c3db1501
Nov 14 19:12:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59694399-9052-419a-a869-fc5dc8a7b1bc tempest-TaggedAttachmentsTest-551564993 tempest-TaggedAttachmentsTest-551564993-project-member] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.411s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-b2c1553a-f373-4b36-8064-19dce1a41e7d req-f4bdd917-6c54-4fae-98f6-15627aa911dc service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-plugged-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b2c1553a-f373-4b36-8064-19dce1a41e7d req-f4bdd917-6c54-4fae-98f6-15627aa911dc service nova] Acquiring lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b2c1553a-f373-4b36-8064-19dce1a41e7d req-f4bdd917-6c54-4fae-98f6-15627aa911dc service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b2c1553a-f373-4b36-8064-19dce1a41e7d req-f4bdd917-6c54-4fae-98f6-15627aa911dc service nova] Lock "b2696233-b1c2-466d-92f1-0a30c3db1501-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-b2c1553a-f373-4b36-8064-19dce1a41e7d req-f4bdd917-6c54-4fae-98f6-15627aa911dc service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] No waiting events found dispatching network-vif-plugged-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:06 user nova-compute[75205]: WARNING nova.compute.manager [req-b2c1553a-f373-4b36-8064-19dce1a41e7d req-f4bdd917-6c54-4fae-98f6-15627aa911dc service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received unexpected event network-vif-plugged-56984858-000b-45d7-a6f0-13dc113e14f6 for instance with vm_state deleted and task_state None.
Nov 14 19:12:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-b2c1553a-f373-4b36-8064-19dce1a41e7d req-f4bdd917-6c54-4fae-98f6-15627aa911dc service nova] [instance: b2696233-b1c2-466d-92f1-0a30c3db1501] Received event network-vif-deleted-56984858-000b-45d7-a6f0-13dc113e14f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abeb2c2-a1d2-49e7-9d28-ac28188e30c7 req-bc895891-2ffc-49c9-b98b-42747a275632 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abeb2c2-a1d2-49e7-9d28-ac28188e30c7 req-bc895891-2ffc-49c9-b98b-42747a275632 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abeb2c2-a1d2-49e7-9d28-ac28188e30c7 req-bc895891-2ffc-49c9-b98b-42747a275632 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abeb2c2-a1d2-49e7-9d28-ac28188e30c7 req-bc895891-2ffc-49c9-b98b-42747a275632 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abeb2c2-a1d2-49e7-9d28-ac28188e30c7 req-bc895891-2ffc-49c9-b98b-42747a275632 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:07 user nova-compute[75205]: WARNING nova.compute.manager [req-0abeb2c2-a1d2-49e7-9d28-ac28188e30c7 req-bc895891-2ffc-49c9-b98b-42747a275632 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c for instance with vm_state building and task_state spawning.
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-14d1784e-8cf3-472b-a161-9ae4300e9796 req-5584e372-d4d9-467d-ab07-766a9370fde5 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-14d1784e-8cf3-472b-a161-9ae4300e9796 req-5584e372-d4d9-467d-ab07-766a9370fde5 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-14d1784e-8cf3-472b-a161-9ae4300e9796 req-5584e372-d4d9-467d-ab07-766a9370fde5 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-14d1784e-8cf3-472b-a161-9ae4300e9796 req-5584e372-d4d9-467d-ab07-766a9370fde5 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-14d1784e-8cf3-472b-a161-9ae4300e9796 req-5584e372-d4d9-467d-ab07-766a9370fde5 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:08 user nova-compute[75205]: WARNING nova.compute.manager [req-14d1784e-8cf3-472b-a161-9ae4300e9796 req-5584e372-d4d9-467d-ab07-766a9370fde5 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-3a669c43-3923-4432-ab6a-466136662357 for instance with vm_state building and task_state spawning.
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-93e1a7a3-f325-46af-8a9d-b37db8f44de2 req-70d459bc-f0b3-4213-8737-1c5420d6676f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-93e1a7a3-f325-46af-8a9d-b37db8f44de2 req-70d459bc-f0b3-4213-8737-1c5420d6676f service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-93e1a7a3-f325-46af-8a9d-b37db8f44de2 req-70d459bc-f0b3-4213-8737-1c5420d6676f service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-93e1a7a3-f325-46af-8a9d-b37db8f44de2 req-70d459bc-f0b3-4213-8737-1c5420d6676f service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-93e1a7a3-f325-46af-8a9d-b37db8f44de2 req-70d459bc-f0b3-4213-8737-1c5420d6676f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:09 user nova-compute[75205]: WARNING nova.compute.manager [req-93e1a7a3-f325-46af-8a9d-b37db8f44de2 req-70d459bc-f0b3-4213-8737-1c5420d6676f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-60da9c54-607a-4873-94fd-e2d42286a938 for instance with vm_state building and task_state spawning.
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:10 user nova-compute[75205]: WARNING nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c for instance with vm_state building and task_state spawning.
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:10 user nova-compute[75205]: WARNING nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-abe87def-a869-4cb5-8d72-3f231507f40e for instance with vm_state building and task_state spawning.
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:10 user nova-compute[75205]: WARNING nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-abe87def-a869-4cb5-8d72-3f231507f40e for instance with vm_state building and task_state spawning.
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:10 user nova-compute[75205]: WARNING nova.compute.manager [req-73d79128-6246-4567-9f5b-95f6a1abaf94 req-773dcb2f-158f-4e79-b7af-e179b84a3a85 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-04afe31a-5ddd-475b-a353-9465641b535f for instance with vm_state building and task_state spawning.
Nov 14 19:12:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'flavor' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:10 user nova-compute[75205]: WARNING nova.compute.manager [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-3a669c43-3923-4432-ab6a-466136662357 for instance with vm_state building and task_state spawning.
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:10 user nova-compute[75205]: WARNING nova.compute.manager [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c for instance with vm_state building and task_state spawning.
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:10 user nova-compute[75205]: WARNING nova.compute.manager [req-67095e11-e3f3-450e-925d-61c32018f5c3 req-f6641b2c-eae9-41d1-bef3-246cb95b6d72 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c for instance with vm_state building and task_state spawning.
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:10 user nova-compute[75205]: INFO nova.compute.manager [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Attaching volume 07a2629c-7268-42d8-9903-9cefe7fe77e4 to /dev/vdb
Nov 14 19:12:10 user nova-compute[75205]: DEBUG os_brick.utils [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a00e6f-2670-4800-bb0b-2bbb5fdb43cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc547a3-42af-480e-b156-c05a38e34500]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e55185-c926-4db7-902a-804dcb71b6cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[540f3b09-bf9b-4c79-9e0f-7e863c9529bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:12:10 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:12:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfe13c9-1a2f-49ad-9f77-a281b493b8af]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG os_brick.utils [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updating existing volume attachment record: 208abe62-546e-46e2-b745-70bea0c9cd50 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:11 user nova-compute[75205]: WARNING nova.compute.manager [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-60da9c54-607a-4873-94fd-e2d42286a938 for instance with vm_state building and task_state spawning.
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:11 user nova-compute[75205]: WARNING nova.compute.manager [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d for instance with vm_state building and task_state spawning.
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:11 user nova-compute[75205]: WARNING nova.compute.manager [req-b42a52cf-ba8a-434d-9e2a-7d252afd21ac req-32aec915-1c40-481b-af9e-6630fa38229f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d for instance with vm_state building and task_state spawning.
Nov 14 19:12:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:12:11 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance spawned successfully.
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:11 user nova-compute[75205]: INFO nova.compute.manager [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Took 11.11 seconds to spawn the instance on the hypervisor.
Nov 14 19:12:11 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:12:11 user nova-compute[75205]: INFO nova.compute.manager [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Took 27.47 seconds to build instance.
Nov 14 19:12:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b037bfee-05a5-4595-87b9-d29fda893105 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.567s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-914697e9-163b-4505-b81f-b3173c602cf3 req-3386d884-fbb8-46cb-9c36-1de4238ea6ca service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-914697e9-163b-4505-b81f-b3173c602cf3 req-3386d884-fbb8-46cb-9c36-1de4238ea6ca service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-914697e9-163b-4505-b81f-b3173c602cf3 req-3386d884-fbb8-46cb-9c36-1de4238ea6ca service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-914697e9-163b-4505-b81f-b3173c602cf3 req-3386d884-fbb8-46cb-9c36-1de4238ea6ca service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-914697e9-163b-4505-b81f-b3173c602cf3 req-3386d884-fbb8-46cb-9c36-1de4238ea6ca service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:12 user nova-compute[75205]: WARNING nova.compute.manager [req-914697e9-163b-4505-b81f-b3173c602cf3 req-3386d884-fbb8-46cb-9c36-1de4238ea6ca service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-04afe31a-5ddd-475b-a353-9465641b535f for instance with vm_state active and task_state None.
Nov 14 19:12:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fODSxAQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:12:15 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:15 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:15 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad81bc01-8601-4a23-9aec-a69ac8f44de5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:12:15 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d353191c-7967-4881-9fab-2c28c0a13259]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4] added
Nov 14 19:12:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f6e317-db6d-412c-a11c-33c0ac391729]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6692b19-b089-41bf-ad69-ae5c022be8a5]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fODSxAQJ {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fODSxAQJ" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee37b915-9f78-4dab-bdac-085d4c677b55]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fODSxAQJ'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c763aa46-fa9c-41e1-903b-aeae0c228d53]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcd79b6-835c-417e-8e90-ce299b8946f7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65daf5a-78d2-45df-a826-1ca66618f164]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4, portal: 172.16.0.220,3260]
Nov 14 19:12:16 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4, portal: 172.16.0.220,3260] successful.
Nov 14 19:12:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2365a254-7f34-41d0-a324-e261f7dfba1b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e9d20-f5d2-45ca-a489-aa708f6a2e71]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] HCTL ('40', '-', '-', 0) found on session 19 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe9ee7f-3822-4092-a6a9-8c8510ca398c]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Searching for a device in session 19 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fODSxAQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:16 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 26a6a013-500d-4502-a9f1-cffef3c4ba27 is timed out.
Nov 14 19:12:16 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Successfully detached device vdb from instance 26a6a013-500d-4502-a9f1-cffef3c4ba27 from the live domain config.
Nov 14 19:12:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWGxbIFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:12:16 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26636363033363431', 'path': '/dev/sdi'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636363033363431', 'path': '/dev/sdi'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.226s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'flavor' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01502ba-96f2-4e6d-a94a-f764c593124f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:12:17 user nova-compute[75205]: No targets found.
Nov 14 19:12:17 user nova-compute[75205]: iSNS:
Nov 14 19:12:17 user nova-compute[75205]: No targets found.
Nov 14 19:12:17 user nova-compute[75205]: STATIC:
Nov 14 19:12:17 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759
Nov 14 19:12:17 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:17 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:17 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1
Nov 14 19:12:17 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:17 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:17 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4
Nov 14 19:12:17 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:17 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:17 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:12:17 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:17 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:17 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76
Nov 14 19:12:17 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:17 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:17 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e
Nov 14 19:12:17 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:17 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:17 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70
Nov 14 19:12:17 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:17 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:17 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:12:17 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:17 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:17 user nova-compute[75205]: FIRMWARE:
Nov 14 19:12:17 user nova-compute[75205]: No targets found.
Nov 14 19:12:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:12:17 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:12:17 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:12:17 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:12:17 user nova-compute[75205]:   <source dev="/dev/sdi"/>
Nov 14 19:12:17 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:12:17 user nova-compute[75205]:   <serial>07a2629c-7268-42d8-9903-9cefe7fe77e4</serial>
Nov 14 19:12:17 user nova-compute[75205]: </disk>
Nov 14 19:12:17 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cef14db-0d35-401c-a647-9ab81c9c3b01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1e8b4e-0a51-4e2c-b29c-21a18dd16633]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7410af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70'): ({'sdd'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Removing single pathed devices sdd {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55d7d18-a127-4fdd-978e-5748afab014e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[123e6c48-5655-4a53-9188-49ca78eb3cf4]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Flushing IO for device /dev/sdd {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca3778-56e0-41c8-ae05-c892afbfb150]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51134b8-8297-48a5-8adb-40e96a519972]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbaaa32-1f80-42c9-b085-2b76207dae88]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cda3ea-ae8e-4380-b246-8da1987e0be3]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70, portal: 172.16.0.220,3260]
Nov 14 19:12:17 user nova-compute[75205]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70, portal: 172.16.0.220,3260] successful.
Nov 14 19:12:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9979d2e2-8b97-48fd-88e2-bbc61211ec70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f7482-e0f9-4a72-9abf-6f1f0f7301a1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] <== disconnect_volume: return (562ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] No VIF found with MAC fa:16:3e:36:db:ab, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:12:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cb7a2fde-07cb-416b-b70a-2ed811524b25 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.185s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:18 user nova-compute[75205]: DEBUG nova.objects.instance [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lazy-loading 'flavor' on Instance uuid 26a6a013-500d-4502-a9f1-cffef3c4ba27 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-299d4ad8-06f6-4c0a-a5c7-5d98e6c59bf2 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.987s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:18 user nova-compute[75205]: INFO nova.compute.manager [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Rescuing
Nov 14 19:12:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:12:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquired lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:12:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:12:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updating instance_info_cache with network_info: [{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Releasing lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-5766f5b7-6511-4d0d-bcac-ad3f2259930a req-e5be8179-85da-4233-8b19-bf4a74529258 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-unplugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5766f5b7-6511-4d0d-bcac-ad3f2259930a req-e5be8179-85da-4233-8b19-bf4a74529258 service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5766f5b7-6511-4d0d-bcac-ad3f2259930a req-e5be8179-85da-4233-8b19-bf4a74529258 service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5766f5b7-6511-4d0d-bcac-ad3f2259930a req-e5be8179-85da-4233-8b19-bf4a74529258 service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-5766f5b7-6511-4d0d-bcac-ad3f2259930a req-e5be8179-85da-4233-8b19-bf4a74529258 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-unplugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:19 user nova-compute[75205]: WARNING nova.compute.manager [req-5766f5b7-6511-4d0d-bcac-ad3f2259930a req-e5be8179-85da-4233-8b19-bf4a74529258 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-unplugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state active and task_state rescuing.
Nov 14 19:12:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Instance destroyed successfully.
Nov 14 19:12:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Attempting a stable device rescue
Nov 14 19:12:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75205) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Instance directory exists: not creating {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 19:12:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Creating image(s)
Nov 14 19:12:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'trusted_certs' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "804d885052f50757d09556d31ae90dcb33cbf818" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "804d885052f50757d09556d31ae90dcb33cbf818" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:20 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:12:20 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:12:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:12:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818.part --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.virt.images [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] 1151a4a2-f692-44c7-a1fe-4ca5d0d388ad was qcow2, converting to raw {{(pid=75205) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818.part /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818.converted {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818.part /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818.converted" returned: 0 in 0.352s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818.converted --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-55e2c0f6-9d52-450d-a41a-49a2d7f40f42 req-d4c88dbc-0d35-460d-b0bd-43ad0ed509ce service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-55e2c0f6-9d52-450d-a41a-49a2d7f40f42 req-d4c88dbc-0d35-460d-b0bd-43ad0ed509ce service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-55e2c0f6-9d52-450d-a41a-49a2d7f40f42 req-d4c88dbc-0d35-460d-b0bd-43ad0ed509ce service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-55e2c0f6-9d52-450d-a41a-49a2d7f40f42 req-d4c88dbc-0d35-460d-b0bd-43ad0ed509ce service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-55e2c0f6-9d52-450d-a41a-49a2d7f40f42 req-d4c88dbc-0d35-460d-b0bd-43ad0ed509ce service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:21 user nova-compute[75205]: WARNING nova.compute.manager [req-55e2c0f6-9d52-450d-a41a-49a2d7f40f42 req-d4c88dbc-0d35-460d-b0bd-43ad0ed509ce service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state active and task_state rescuing.
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "804d885052f50757d09556d31ae90dcb33cbf818" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.760s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "804d885052f50757d09556d31ae90dcb33cbf818" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "804d885052f50757d09556d31ae90dcb33cbf818" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818 --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Updating instance_info_cache with network_info: [{"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-2d89bc07-90a1-49ef-8d67-e7263bd06e6d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818 --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818,backing_fmt=raw /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818,backing_fmt=raw /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue" returned: 0 in 0.047s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "804d885052f50757d09556d31ae90dcb33cbf818" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'migration_context' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.objects.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Object Instance<92c7bf54-2b89-4a52-ab91-5ece2bd48b73> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Start _get_guest_xml network_info=[{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "vif_mac": "fa:16:3e:36:db:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1151a4a2-f692-44c7-a1fe-4ca5d0d388ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fODSxAQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '92c7bf54-2b89-4a52-ab91-5ece2bd48b73', 'attached_at': '', 'detached_at': '', 'volume_id': '07a2629c-7268-42d8-9903-9cefe7fe77e4', 'serial': '07a2629c-7268-42d8-9903-9cefe7fe77e4'}, 'attachment_id': '208abe62-546e-46e2-b745-70bea0c9cd50', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'resources' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.objects.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Object Instance<92c7bf54-2b89-4a52-ab91-5ece2bd48b73> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'numa_topology' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:21 user nova-compute[75205]: DEBUG nova.objects.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Object Instance<92c7bf54-2b89-4a52-ab91-5ece2bd48b73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:12:21 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:12:22 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.objects.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Object Instance<92c7bf54-2b89-4a52-ab91-5ece2bd48b73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fODSxAQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:12:22 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:22 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:22 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[177bac0d-7fb5-41d5-8ca8-18c97091e307]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fODSxAQJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 19:12:22 user nova-compute[75205]: node.name = iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4
Nov 14 19:12:22 user nova-compute[75205]: node.tpgt = -1
Nov 14 19:12:22 user nova-compute[75205]: node.startup = automatic
Nov 14 19:12:22 user nova-compute[75205]: node.leading_login = No
Nov 14 19:12:22 user nova-compute[75205]: iface.iscsi_ifacename = default
Nov 14 19:12:22 user nova-compute[75205]: iface.net_ifacename = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.ipaddress = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.prefix_len = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.hwaddress = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.transport_name = tcp
Nov 14 19:12:22 user nova-compute[75205]: iface.initiatorname = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.state = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.vlan_id = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.vlan_priority = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.vlan_state = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.iface_num = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.mtu = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.port = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.bootproto = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.subnet_mask = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.gateway = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.dhcp_alt_client_id = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.dhcp_dns = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.dhcp_learn_iqn = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.dhcp_vendor_id_state = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.dhcp_vendor_id = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.dhcp_slp_da = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.fragmentation = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.gratuitous_arp = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.incoming_forwarding = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.tos_state = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.tos = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.ttl = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.delayed_ack = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.tcp_nagle = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.tcp_wsf_state = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.tcp_wsf = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.tcp_timer_scale = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.tcp_timestamp = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.redirect = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.def_task_mgmt_timeout = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.header_digest = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.data_digest = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.immediate_data = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.initial_r2t = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.data_seq_inorder = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.data_pdu_inorder = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.erl = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.max_receive_data_len = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.first_burst_len = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.max_outstanding_r2t = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.max_burst_len = 0
Nov 14 19:12:22 user nova-compute[75205]: iface.chap_auth = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.bidi_chap = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.strict_login_compliance = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.discovery_auth = <empty>
Nov 14 19:12:22 user nova-compute[75205]: iface.discovery_logout = <empty>
Nov 14 19:12:22 user nova-compute[75205]: node.discovery_address = <empty>
Nov 14 19:12:22 user nova-compute[75205]: node.discovery_port = 0
Nov 14 19:12:22 user nova-compute[75205]: node.discovery_type = static
Nov 14 19:12:22 user nova-compute[75205]: node.session.initial_cmdsn = 0
Nov 14 19:12:22 user nova-compute[75205]: node.session.initial_login_retry_max = 8
Nov 14 19:12:22 user nova-compute[75205]: node.session.xmit_thread_priority = -20
Nov 14 19:12:22 user nova-compute[75205]: node.session.cmds_max = 128
Nov 14 19:12:22 user nova-compute[75205]: node.session.queue_depth = 32
Nov 14 19:12:22 user nova-compute[75205]: node.session.nr_sessions = 1
Nov 14 19:12:22 user nova-compute[75205]: node.session.auth.authmethod = CHAP
Nov 14 19:12:22 user nova-compute[75205]: node.session.auth.username = fODSxAQJ
Nov 14 19:12:22 user nova-compute[75205]: node.session.auth.password = ***
Nov 14 19:12:22 user nova-compute[75205]: node.session.auth.username_in = <empty>
Nov 14 19:12:22 user nova-compute[75205]: node.session.auth.password_in = <empty>
Nov 14 19:12:22 user nova-compute[75205]: node.session.auth.chap_algs = MD5
Nov 14 19:12:22 user nova-compute[75205]: node.session.timeo.replacement_timeout = 120
Nov 14 19:12:22 user nova-compute[75205]: node.session.err_timeo.abort_timeout = 15
Nov 14 19:12:22 user nova-compute[75205]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 19:12:22 user nova-compute[75205]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 19:12:22 user nova-compute[75205]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 19:12:22 user nova-compute[75205]: node.session.iscsi.FastAbort = Yes
Nov 14 19:12:22 user nova-compute[75205]: node.session.iscsi.InitialR2T = No
Nov 14 19:12:22 user nova-compute[75205]: node.session.iscsi.ImmediateData = Yes
Nov 14 19:12:22 user nova-compute[75205]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 19:12:22 user nova-compute[75205]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 19:12:22 user nova-compute[75205]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 19:12:22 user nova-compute[75205]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 19:12:22 user nova-compute[75205]: node.session.iscsi.MaxConnections = 1
Nov 14 19:12:22 user nova-compute[75205]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 19:12:22 user nova-compute[75205]: node.session.iscsi.ERL = 0
Nov 14 19:12:22 user nova-compute[75205]: node.session.scan = manual
Nov 14 19:12:22 user nova-compute[75205]: node.session.reopen_max = 0
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].address = 172.16.0.220
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].port = 3260
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].startup = manual
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].tcp.window_size = 524288
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].tcp.type_of_service = 0
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].timeo.logout_timeout = 15
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].timeo.login_timeout = 15
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].timeo.auth_timeout = 45
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].iscsi.DataDigest = None
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].iscsi.IFMarker = No
Nov 14 19:12:22 user nova-compute[75205]: node.conn[0].iscsi.OFMarker = No
Nov 14 19:12:22 user nova-compute[75205]: # END RECORD
Nov 14 19:12:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d4d99b-81d1-4a89-91f8-2581aedf0dc8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4397db7f-e6a9-42f4-8341-db5a610fa935]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fODSxAQJ {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fODSxAQJ" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e859de8-d8f5-4a4b-9552-c7c80e935c0e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fODSxAQJ'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36aaecf-5a83-4700-baf5-14ef0f9b13ae]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f98336-376e-4e64-9c1a-bb80cfb42394]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.175s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] HCTL ('40', '0', '0', 0) found on session 19 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Scanning host 40 c: 0, t: 0, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.045s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a5349-31e5-449b-9d8f-fdc441bf17b5]: (4, ('0 0 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Searching for a device in session 19 and hctl ('40', '0', '0', 0) yield: sdi {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fODSxAQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.231s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] <== connect_volume: return (232ms) {'type': 'block', 'scsi_wwn': '26636363033363431', 'path': '/dev/sdi'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636363033363431', 'path': '/dev/sdi'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1676998227',display_name='tempest-ServerStableDeviceRescueTest-server-1676998227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1676998227',id=3,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMICd9+/orLPOsksqqlXHWvNgODZ4beOKu5xU3X7tWgZC7C97oMTnqzPjEA1MxOE12JNfb4DNQCXeLb4+/3grN8spf9YFebiUCphHxLaLozc5X8YRCA0KWPqw4Wn2b/wOw==',key_name='tempest-keypair-1396550108',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e772e661157e4c6e93e46e7dd9f42f0c',ramdisk_id='',reservation_id='r-d71nwys7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-660038347',owner_user_name='tempest-ServerStableDeviceRescueTest-660038347-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:10:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49f6cbfae91a4b388f1430a3b7a2707c',uuid=92c7bf54-2b89-4a52-ab91-5ece2bd48b73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "vif_mac": "fa:16:3e:36:db:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Converting VIF {"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "vif_mac": "fa:16:3e:36:db:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:db:ab,bridge_name='br-int',has_traffic_filtering=True,id=531d9209-139e-4463-9116-04f04ddca88e,network=Network(3c910353-259e-4f46-87f3-f8e4aea096e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531d9209-13') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'pci_devices' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.objects.base [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Object Instance<92c7bf54-2b89-4a52-ab91-5ece2bd48b73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:12:22 user nova-compute[75205]:   <uuid>92c7bf54-2b89-4a52-ab91-5ece2bd48b73</uuid>
Nov 14 19:12:22 user nova-compute[75205]:   <name>instance-00000003</name>
Nov 14 19:12:22 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:12:22 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:12:22 user nova-compute[75205]:   <metadata>
Nov 14 19:12:22 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:12:22 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:12:22 user nova-compute[75205]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1676998227</nova:name>
Nov 14 19:12:22 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:12:22</nova:creationTime>
Nov 14 19:12:22 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:12:22 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:12:22 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:12:22 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:12:22 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:12:22 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:12:22 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:12:22 user nova-compute[75205]:       <nova:owner>
Nov 14 19:12:22 user nova-compute[75205]:         <nova:user uuid="49f6cbfae91a4b388f1430a3b7a2707c">tempest-ServerStableDeviceRescueTest-660038347-project-member</nova:user>
Nov 14 19:12:22 user nova-compute[75205]:         <nova:project uuid="e772e661157e4c6e93e46e7dd9f42f0c">tempest-ServerStableDeviceRescueTest-660038347</nova:project>
Nov 14 19:12:22 user nova-compute[75205]:       </nova:owner>
Nov 14 19:12:22 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:12:22 user nova-compute[75205]:       <nova:ports>
Nov 14 19:12:22 user nova-compute[75205]:         <nova:port uuid="531d9209-139e-4463-9116-04f04ddca88e">
Nov 14 19:12:22 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 19:12:22 user nova-compute[75205]:         </nova:port>
Nov 14 19:12:22 user nova-compute[75205]:       </nova:ports>
Nov 14 19:12:22 user nova-compute[75205]:     </nova:instance>
Nov 14 19:12:22 user nova-compute[75205]:   </metadata>
Nov 14 19:12:22 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:12:22 user nova-compute[75205]:     <system>
Nov 14 19:12:22 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:12:22 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:12:22 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:12:22 user nova-compute[75205]:       <entry name="serial">92c7bf54-2b89-4a52-ab91-5ece2bd48b73</entry>
Nov 14 19:12:22 user nova-compute[75205]:       <entry name="uuid">92c7bf54-2b89-4a52-ab91-5ece2bd48b73</entry>
Nov 14 19:12:22 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:12:22 user nova-compute[75205]:     </system>
Nov 14 19:12:22 user nova-compute[75205]:   </sysinfo>
Nov 14 19:12:22 user nova-compute[75205]:   <os>
Nov 14 19:12:22 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:12:22 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:12:22 user nova-compute[75205]:   </os>
Nov 14 19:12:22 user nova-compute[75205]:   <features>
Nov 14 19:12:22 user nova-compute[75205]:     <acpi/>
Nov 14 19:12:22 user nova-compute[75205]:     <apic/>
Nov 14 19:12:22 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:12:22 user nova-compute[75205]:   </features>
Nov 14 19:12:22 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:12:22 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:12:22 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:12:22 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:12:22 user nova-compute[75205]:   </clock>
Nov 14 19:12:22 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:12:22 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:12:22 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:12:22 user nova-compute[75205]:   </cpu>
Nov 14 19:12:22 user nova-compute[75205]:   <devices>
Nov 14 19:12:22 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:12:22 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:12:22 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk"/>
Nov 14 19:12:22 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:12:22 user nova-compute[75205]:     </disk>
Nov 14 19:12:22 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:12:22 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:12:22 user nova-compute[75205]:       <source dev="/dev/sdi"/>
Nov 14 19:12:22 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:12:22 user nova-compute[75205]:       <serial>07a2629c-7268-42d8-9903-9cefe7fe77e4</serial>
Nov 14 19:12:22 user nova-compute[75205]:     </disk>
Nov 14 19:12:22 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:12:22 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:12:22 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue"/>
Nov 14 19:12:22 user nova-compute[75205]:       <target dev="vdc" bus="virtio"/>
Nov 14 19:12:22 user nova-compute[75205]:       <boot order="1"/>
Nov 14 19:12:22 user nova-compute[75205]:     </disk>
Nov 14 19:12:22 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:12:22 user nova-compute[75205]:       <mac address="fa:16:3e:36:db:ab"/>
Nov 14 19:12:22 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:22 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:12:22 user nova-compute[75205]:       <target dev="tap531d9209-13"/>
Nov 14 19:12:22 user nova-compute[75205]:     </interface>
Nov 14 19:12:22 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:12:22 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/console.log" append="off"/>
Nov 14 19:12:22 user nova-compute[75205]:     </serial>
Nov 14 19:12:22 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:12:22 user nova-compute[75205]:     <video>
Nov 14 19:12:22 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:22 user nova-compute[75205]:     </video>
Nov 14 19:12:22 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:12:22 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:12:22 user nova-compute[75205]:     </rng>
Nov 14 19:12:22 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:12:22 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:12:22 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:12:22 user nova-compute[75205]:     </memballoon>
Nov 14 19:12:22 user nova-compute[75205]:   </devices>
Nov 14 19:12:22 user nova-compute[75205]: </domain>
Nov 14 19:12:22 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:12:22 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Instance destroyed successfully.
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] No VIF found with MAC fa:16:3e:36:db:ab, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:12:22 user nova-compute[75205]: INFO nova.compute.claims [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Claim successful on node user
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:12:23 user nova-compute[75205]: INFO nova.compute.claims [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Claim successful on node user
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:12:23 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.policy [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b03af1014734b1a8d4c2633756070e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eabb88364cd4173ba71aa8920d40954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:12:23 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Creating image(s)
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.191s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk 1073741824" returned: 0 in 0.067s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG nova.network.neutron [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:24 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.compute.manager [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.compute.manager [req-fa0b53d9-5e95-4c69-a0e4-e1f3449baf21 req-e99c38e4-71b9-4da4-92a6-12433461a49f service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fa0b53d9-5e95-4c69-a0e4-e1f3449baf21 req-e99c38e4-71b9-4da4-92a6-12433461a49f service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fa0b53d9-5e95-4c69-a0e4-e1f3449baf21 req-e99c38e4-71b9-4da4-92a6-12433461a49f service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fa0b53d9-5e95-4c69-a0e4-e1f3449baf21 req-e99c38e4-71b9-4da4-92a6-12433461a49f service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.compute.manager [req-fa0b53d9-5e95-4c69-a0e4-e1f3449baf21 req-e99c38e4-71b9-4da4-92a6-12433461a49f service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:24 user nova-compute[75205]: WARNING nova.compute.manager [req-fa0b53d9-5e95-4c69-a0e4-e1f3449baf21 req-e99c38e4-71b9-4da4-92a6-12433461a49f service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state active and task_state rescuing.
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Successfully created port: e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.278s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.policy [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b03af1014734b1a8d4c2633756070e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eabb88364cd4173ba71aa8920d40954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.compute.manager [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:12:24 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Creating image(s)
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Cannot resize image /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Ensure instance console log exists: /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.263s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.270s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk 1073741824" returned: 0 in 0.092s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Successfully updated port: e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquired lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.206s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Successfully created port: a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-2aef795d-c8f1-4a47-a2b3-d01474a824bf req-ea9e55e2-6c04-4789-baf2-3b5601b07468 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-changed-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-2aef795d-c8f1-4a47-a2b3-d01474a824bf req-ea9e55e2-6c04-4789-baf2-3b5601b07468 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Refreshing instance network info cache due to event network-changed-e2673078-5990-442a-ab11-60a51b39057e. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2aef795d-c8f1-4a47-a2b3-d01474a824bf req-ea9e55e2-6c04-4789-baf2-3b5601b07468 service nova] Acquiring lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27/disk --force-share --output=json" returned: 0 in 0.373s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Cannot resize image /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Ensure instance console log exists: /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Updating instance_info_cache with network_info: [{"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Releasing lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Instance network_info: |[{"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2aef795d-c8f1-4a47-a2b3-d01474a824bf req-ea9e55e2-6c04-4789-baf2-3b5601b07468 service nova] Acquired lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.network.neutron [req-2aef795d-c8f1-4a47-a2b3-d01474a824bf req-ea9e55e2-6c04-4789-baf2-3b5601b07468 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Refreshing network info cache for port e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Start _get_guest_xml network_info=[{"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:12:25 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:12:25 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1510501547',display_name='tempest-ServerRescueNegativeTestJSON-server-1510501547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1510501547',id=16,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-rl9b6fr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:12:23Z,user_data=None,user_id='1b03af1014734b1a8d4c2633756070e8',uuid=41394628-10e9-4adc-8bd5-0eae6cfe1f8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=e2673078-5990-442a-ab11-60a51b39057e,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2673078-59') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'pci_devices' on Instance uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:12:25 user nova-compute[75205]:   <uuid>41394628-10e9-4adc-8bd5-0eae6cfe1f8a</uuid>
Nov 14 19:12:25 user nova-compute[75205]:   <name>instance-00000010</name>
Nov 14 19:12:25 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:12:25 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:12:25 user nova-compute[75205]:   <metadata>
Nov 14 19:12:25 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:12:25 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:12:25 user nova-compute[75205]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1510501547</nova:name>
Nov 14 19:12:25 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:12:25</nova:creationTime>
Nov 14 19:12:25 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:12:25 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:12:25 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:12:25 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:12:25 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:12:25 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:12:25 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:12:25 user nova-compute[75205]:       <nova:owner>
Nov 14 19:12:25 user nova-compute[75205]:         <nova:user uuid="1b03af1014734b1a8d4c2633756070e8">tempest-ServerRescueNegativeTestJSON-278369752-project-member</nova:user>
Nov 14 19:12:25 user nova-compute[75205]:         <nova:project uuid="7eabb88364cd4173ba71aa8920d40954">tempest-ServerRescueNegativeTestJSON-278369752</nova:project>
Nov 14 19:12:25 user nova-compute[75205]:       </nova:owner>
Nov 14 19:12:25 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:12:25 user nova-compute[75205]:       <nova:ports>
Nov 14 19:12:25 user nova-compute[75205]:         <nova:port uuid="e2673078-5990-442a-ab11-60a51b39057e">
Nov 14 19:12:25 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 19:12:25 user nova-compute[75205]:         </nova:port>
Nov 14 19:12:25 user nova-compute[75205]:       </nova:ports>
Nov 14 19:12:25 user nova-compute[75205]:     </nova:instance>
Nov 14 19:12:25 user nova-compute[75205]:   </metadata>
Nov 14 19:12:25 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:12:25 user nova-compute[75205]:     <system>
Nov 14 19:12:25 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:12:25 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:12:25 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:12:25 user nova-compute[75205]:       <entry name="serial">41394628-10e9-4adc-8bd5-0eae6cfe1f8a</entry>
Nov 14 19:12:25 user nova-compute[75205]:       <entry name="uuid">41394628-10e9-4adc-8bd5-0eae6cfe1f8a</entry>
Nov 14 19:12:25 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:12:25 user nova-compute[75205]:     </system>
Nov 14 19:12:25 user nova-compute[75205]:   </sysinfo>
Nov 14 19:12:25 user nova-compute[75205]:   <os>
Nov 14 19:12:25 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:12:25 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:12:25 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:12:25 user nova-compute[75205]:   </os>
Nov 14 19:12:25 user nova-compute[75205]:   <features>
Nov 14 19:12:25 user nova-compute[75205]:     <acpi/>
Nov 14 19:12:25 user nova-compute[75205]:     <apic/>
Nov 14 19:12:25 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:12:25 user nova-compute[75205]:   </features>
Nov 14 19:12:25 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:12:25 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:12:25 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:12:25 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:12:25 user nova-compute[75205]:   </clock>
Nov 14 19:12:25 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:12:25 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:12:25 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:12:25 user nova-compute[75205]:   </cpu>
Nov 14 19:12:25 user nova-compute[75205]:   <devices>
Nov 14 19:12:25 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:12:25 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:12:25 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk"/>
Nov 14 19:12:25 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:12:25 user nova-compute[75205]:     </disk>
Nov 14 19:12:25 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:12:25 user nova-compute[75205]:       <mac address="fa:16:3e:fe:60:ed"/>
Nov 14 19:12:25 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:25 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:12:25 user nova-compute[75205]:       <target dev="tape2673078-59"/>
Nov 14 19:12:25 user nova-compute[75205]:     </interface>
Nov 14 19:12:25 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:12:25 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/console.log" append="off"/>
Nov 14 19:12:25 user nova-compute[75205]:     </serial>
Nov 14 19:12:25 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:12:25 user nova-compute[75205]:     <video>
Nov 14 19:12:25 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:25 user nova-compute[75205]:     </video>
Nov 14 19:12:25 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:12:25 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:12:25 user nova-compute[75205]:     </rng>
Nov 14 19:12:25 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:12:25 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:12:25 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:12:25 user nova-compute[75205]:     </memballoon>
Nov 14 19:12:25 user nova-compute[75205]:   </devices>
Nov 14 19:12:25 user nova-compute[75205]: </domain>
Nov 14 19:12:25 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1510501547',display_name='tempest-ServerRescueNegativeTestJSON-server-1510501547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1510501547',id=16,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-rl9b6fr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:12:23Z,user_data=None,user_id='1b03af1014734b1a8d4c2633756070e8',uuid=41394628-10e9-4adc-8bd5-0eae6cfe1f8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=e2673078-5990-442a-ab11-60a51b39057e,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2673078-59') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG os_vif [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=e2673078-5990-442a-ab11-60a51b39057e,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2673078-59') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bcf3b24-a8f5-5859-99ef-c76a3e59f616', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2673078-59, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2673078-59, col_values=(('qos', UUID('648523ef-8e20-4eff-883b-3c370f0a7bc7')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2673078-59, col_values=(('external_ids', {'iface-id': 'e2673078-5990-442a-ab11-60a51b39057e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:60:ed', 'vm-uuid': '41394628-10e9-4adc-8bd5-0eae6cfe1f8a'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:25 user nova-compute[75205]: INFO os_vif [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=e2673078-5990-442a-ab11-60a51b39057e,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2673078-59')
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No VIF found with MAC fa:16:3e:fe:60:ed, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.neutron [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Successfully updated port: a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquired lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.neutron [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.neutron [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-82edd506-01b4-47fc-b504-965c4e71f322 req-95406804-cd57-4be7-9822-2ba141084dde service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received event network-changed-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-82edd506-01b4-47fc-b504-965c4e71f322 req-95406804-cd57-4be7-9822-2ba141084dde service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Refreshing instance network info cache due to event network-changed-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-82edd506-01b4-47fc-b504-965c4e71f322 req-95406804-cd57-4be7-9822-2ba141084dde service nova] Acquiring lock "refresh_cache-d66f2088-97a5-4fff-9c0c-3b89b61a2870" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-82edd506-01b4-47fc-b504-965c4e71f322 req-95406804-cd57-4be7-9822-2ba141084dde service nova] Acquired lock "refresh_cache-d66f2088-97a5-4fff-9c0c-3b89b61a2870" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-82edd506-01b4-47fc-b504-965c4e71f322 req-95406804-cd57-4be7-9822-2ba141084dde service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Refreshing network info cache for port 39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:26 user nova-compute[75205]: WARNING nova.compute.manager [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state active and task_state rescuing.
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-changed-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Refreshing instance network info cache due to event network-changed-a15f5508-d912-41f1-8459-a67ea57e481a. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] Acquiring lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-2aef795d-c8f1-4a47-a2b3-d01474a824bf req-ea9e55e2-6c04-4789-baf2-3b5601b07468 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Updated VIF entry in instance network info cache for port e2673078-5990-442a-ab11-60a51b39057e. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-2aef795d-c8f1-4a47-a2b3-d01474a824bf req-ea9e55e2-6c04-4789-baf2-3b5601b07468 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Updating instance_info_cache with network_info: [{"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2aef795d-c8f1-4a47-a2b3-d01474a824bf req-ea9e55e2-6c04-4789-baf2-3b5601b07468 service nova] Releasing lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ffa46191-f1e9-43f6-9ad3-5e6c5a3df816 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.neutron [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Updating instance_info_cache with network_info: [{"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Releasing lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Instance network_info: |[{"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] Acquired lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Refreshing network info cache for port a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Start _get_guest_xml network_info=[{"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:12:26 user nova-compute[75205]: INFO nova.compute.manager [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Terminating instance
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:12:26 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:12:26 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-566278879',display_name='tempest-ServerRescueNegativeTestJSON-server-566278879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-566278879',id=17,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-3ob9ypcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:12:24Z,user_data=None,user_id='1b03af1014734b1a8d4c2633756070e8',uuid=7803fcca-eed8-4088-b1dc-e0908dcecaa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:dd:41,bridge_name='br-int',has_traffic_filtering=True,id=a15f5508-d912-41f1-8459-a67ea57e481a,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15f5508-d9') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.objects.instance [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'pci_devices' on Instance uuid 7803fcca-eed8-4088-b1dc-e0908dcecaa4 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-82edd506-01b4-47fc-b504-965c4e71f322 req-95406804-cd57-4be7-9822-2ba141084dde service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Updated VIF entry in instance network info cache for port 39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-82edd506-01b4-47fc-b504-965c4e71f322 req-95406804-cd57-4be7-9822-2ba141084dde service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Updating instance_info_cache with network_info: [{"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:12:26 user nova-compute[75205]:   <uuid>7803fcca-eed8-4088-b1dc-e0908dcecaa4</uuid>
Nov 14 19:12:26 user nova-compute[75205]:   <name>instance-00000011</name>
Nov 14 19:12:26 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:12:26 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:12:26 user nova-compute[75205]:   <metadata>
Nov 14 19:12:26 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:12:26 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:12:26 user nova-compute[75205]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-566278879</nova:name>
Nov 14 19:12:26 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:12:26</nova:creationTime>
Nov 14 19:12:26 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:12:26 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:12:26 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:12:26 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:12:26 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:12:26 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:12:26 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:12:26 user nova-compute[75205]:       <nova:owner>
Nov 14 19:12:26 user nova-compute[75205]:         <nova:user uuid="1b03af1014734b1a8d4c2633756070e8">tempest-ServerRescueNegativeTestJSON-278369752-project-member</nova:user>
Nov 14 19:12:26 user nova-compute[75205]:         <nova:project uuid="7eabb88364cd4173ba71aa8920d40954">tempest-ServerRescueNegativeTestJSON-278369752</nova:project>
Nov 14 19:12:26 user nova-compute[75205]:       </nova:owner>
Nov 14 19:12:26 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:12:26 user nova-compute[75205]:       <nova:ports>
Nov 14 19:12:26 user nova-compute[75205]:         <nova:port uuid="a15f5508-d912-41f1-8459-a67ea57e481a">
Nov 14 19:12:26 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:12:26 user nova-compute[75205]:         </nova:port>
Nov 14 19:12:26 user nova-compute[75205]:       </nova:ports>
Nov 14 19:12:26 user nova-compute[75205]:     </nova:instance>
Nov 14 19:12:26 user nova-compute[75205]:   </metadata>
Nov 14 19:12:26 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:12:26 user nova-compute[75205]:     <system>
Nov 14 19:12:26 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:12:26 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:12:26 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:12:26 user nova-compute[75205]:       <entry name="serial">7803fcca-eed8-4088-b1dc-e0908dcecaa4</entry>
Nov 14 19:12:26 user nova-compute[75205]:       <entry name="uuid">7803fcca-eed8-4088-b1dc-e0908dcecaa4</entry>
Nov 14 19:12:26 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:12:26 user nova-compute[75205]:     </system>
Nov 14 19:12:26 user nova-compute[75205]:   </sysinfo>
Nov 14 19:12:26 user nova-compute[75205]:   <os>
Nov 14 19:12:26 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:12:26 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:12:26 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:12:26 user nova-compute[75205]:   </os>
Nov 14 19:12:26 user nova-compute[75205]:   <features>
Nov 14 19:12:26 user nova-compute[75205]:     <acpi/>
Nov 14 19:12:26 user nova-compute[75205]:     <apic/>
Nov 14 19:12:26 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:12:26 user nova-compute[75205]:   </features>
Nov 14 19:12:26 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:12:26 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:12:26 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:12:26 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:12:26 user nova-compute[75205]:   </clock>
Nov 14 19:12:26 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:12:26 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:12:26 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:12:26 user nova-compute[75205]:   </cpu>
Nov 14 19:12:26 user nova-compute[75205]:   <devices>
Nov 14 19:12:26 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:12:26 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:12:26 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk"/>
Nov 14 19:12:26 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:12:26 user nova-compute[75205]:     </disk>
Nov 14 19:12:26 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:12:26 user nova-compute[75205]:       <mac address="fa:16:3e:ee:dd:41"/>
Nov 14 19:12:26 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:26 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:12:26 user nova-compute[75205]:       <target dev="tapa15f5508-d9"/>
Nov 14 19:12:26 user nova-compute[75205]:     </interface>
Nov 14 19:12:26 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:12:26 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/console.log" append="off"/>
Nov 14 19:12:26 user nova-compute[75205]:     </serial>
Nov 14 19:12:26 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:12:26 user nova-compute[75205]:     <video>
Nov 14 19:12:26 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:12:26 user nova-compute[75205]:     </video>
Nov 14 19:12:26 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:12:26 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:12:26 user nova-compute[75205]:     </rng>
Nov 14 19:12:26 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:12:26 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:12:26 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:12:26 user nova-compute[75205]:     </memballoon>
Nov 14 19:12:26 user nova-compute[75205]:   </devices>
Nov 14 19:12:26 user nova-compute[75205]: </domain>
Nov 14 19:12:26 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-566278879',display_name='tempest-ServerRescueNegativeTestJSON-server-566278879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-566278879',id=17,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-3ob9ypcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:12:24Z,user_data=None,user_id='1b03af1014734b1a8d4c2633756070e8',uuid=7803fcca-eed8-4088-b1dc-e0908dcecaa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:dd:41,bridge_name='br-int',has_traffic_filtering=True,id=a15f5508-d912-41f1-8459-a67ea57e481a,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15f5508-d9') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG os_vif [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:dd:41,bridge_name='br-int',has_traffic_filtering=True,id=a15f5508-d912-41f1-8459-a67ea57e481a,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15f5508-d9') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-82edd506-01b4-47fc-b504-965c4e71f322 req-95406804-cd57-4be7-9822-2ba141084dde service nova] Releasing lock "refresh_cache-d66f2088-97a5-4fff-9c0c-3b89b61a2870" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1853bc1-c000-5db1-b211-9ba05fce5599', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa15f5508-d9, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa15f5508-d9, col_values=(('qos', UUID('2e1ad7ea-e11c-4756-b04d-e955abc0a64d')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa15f5508-d9, col_values=(('external_ids', {'iface-id': 'a15f5508-d912-41f1-8459-a67ea57e481a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:dd:41', 'vm-uuid': '7803fcca-eed8-4088-b1dc-e0908dcecaa4'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:27 user nova-compute[75205]: INFO os_vif [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:dd:41,bridge_name='br-int',has_traffic_filtering=True,id=a15f5508-d912-41f1-8459-a67ea57e481a,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15f5508-d9')
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No VIF found with MAC fa:16:3e:ee:dd:41, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received event network-vif-unplugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] Acquiring lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] No waiting events found dispatching network-vif-unplugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received event network-vif-unplugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received event network-vif-plugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] Acquiring lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] No waiting events found dispatching network-vif-plugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:27 user nova-compute[75205]: WARNING nova.compute.manager [req-e778dd76-8f84-46b0-9166-4ac7fe119aa0 req-8e3d0b1b-58cd-4489-a187-19934c25fe71 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received unexpected event network-vif-plugged-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd for instance with vm_state active and task_state deleting.
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.network.neutron [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Updated VIF entry in instance network info cache for port a15f5508-d912-41f1-8459-a67ea57e481a. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG nova.network.neutron [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Updating instance_info_cache with network_info: [{"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-145706fa-3bae-4882-bd18-42982cde0866 req-568f1036-66ec-4568-825f-86d4bb8a0de9 service nova] Releasing lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG nova.compute.manager [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG nova.compute.manager [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:28 user nova-compute[75205]: WARNING nova.compute.manager [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state building and task_state spawning.
Nov 14 19:12:28 user nova-compute[75205]: DEBUG nova.compute.manager [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG nova.compute.manager [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:28 user nova-compute[75205]: WARNING nova.compute.manager [req-d25810da-b04b-4642-8591-97409b39fd55 req-482c64a5-2251-4596-9e39-c18aa7078158 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state building and task_state spawning.
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:28 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Instance destroyed successfully.
Nov 14 19:12:28 user nova-compute[75205]: DEBUG nova.objects.instance [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'resources' on Instance uuid d66f2088-97a5-4fff-9c0c-3b89b61a2870 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:10:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1304396906',display_name='tempest-AttachVolumeNegativeTest-server-1304396906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1304396906',id=12,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaUfb5XjIN+dYWwErAg2vY14tbQym9SXcdo6iLUsJVmLRUBtC6hnkGvPyjWsdrDPaDYBvhoC4L5g5sXf7iRuczt8MWi6VhlbR3GVQJYKczXFf/L552UX2hcF+5DsJ052w==',key_name='tempest-keypair-725135764',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-j0s503li',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=d66f2088-97a5-4fff-9c0c-3b89b61a2870,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "address": "fa:16:3e:a2:00:16", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39efb8fb-4c", "ovs_interfaceid": "39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:00:16,bridge_name='br-int',has_traffic_filtering=True,id=39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39efb8fb-4c') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG os_vif [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:00:16,bridge_name='br-int',has_traffic_filtering=True,id=39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39efb8fb-4c') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39efb8fb-4c, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3025ddb0-4d60-466d-98ac-dc96df9e8cd3) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:28 user nova-compute[75205]: INFO os_vif [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:00:16,bridge_name='br-int',has_traffic_filtering=True,id=39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39efb8fb-4c')
Nov 14 19:12:28 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Deleting instance files /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870_del
Nov 14 19:12:28 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Deletion of /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870_del complete
Nov 14 19:12:28 user nova-compute[75205]: INFO nova.compute.manager [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Took 2.17 seconds to destroy the instance on the hypervisor.
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk --force-share --output=json" returned: 1 in 0.219s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk --force-share --output=json' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:12:28 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000000c, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/d66f2088-97a5-4fff-9c0c-3b89b61a2870/disk
Nov 14 19:12:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] No waiting events found dispatching network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:31 user nova-compute[75205]: WARNING nova.compute.manager [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received unexpected event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a for instance with vm_state building and task_state spawning.
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] No waiting events found dispatching network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:31 user nova-compute[75205]: WARNING nova.compute.manager [req-7ea43929-b9e5-4495-bcdc-5a0174a83285 req-5b10bbca-e31c-4e85-ba0a-ca2ebbc43871 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received unexpected event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a for instance with vm_state building and task_state spawning.
Nov 14 19:12:31 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:12:31 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7585MB free_disk=25.3525390625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:31 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Instance spawned successfully.
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:31 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Instance spawned successfully.
Nov 14 19:12:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:12:32 user nova-compute[75205]: INFO nova.compute.manager [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Took 8.50 seconds to spawn the instance on the hypervisor.
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1f24f442-1547-4f20-ba7c-f7790dcc37af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 622d19bf-0618-49a9-9f71-b632d9e11301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 26a6a013-500d-4502-a9f1-cffef3c4ba27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d66f2088-97a5-4fff-9c0c-3b89b61a2870 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 55940268-4985-49a7-8e4d-baa0051122cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 34cf679a-1aa5-453a-abca-9db47cf798ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:12:32 user nova-compute[75205]: INFO nova.compute.manager [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Took 7.75 seconds to spawn the instance on the hypervisor.
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:12:32 user nova-compute[75205]: INFO nova.compute.manager [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Took 9.40 seconds to build instance.
Nov 14 19:12:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7e94ce80-2462-4b5b-8a5f-128b529a8b00 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.517s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:32 user nova-compute[75205]: INFO nova.compute.manager [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Took 8.98 seconds to build instance.
Nov 14 19:12:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-502e1fb7-06a0-41db-a7ff-3bb739756221 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.078s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:32 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Took 3.72 seconds to deallocate network for instance.
Nov 14 19:12:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-5313e683-3dd1-4c51-ac0f-c7e5b78c9aa1 req-fd4c9ddd-bcb6-4f0f-9f40-e47cdaf8dde0 service nova] [instance: d66f2088-97a5-4fff-9c0c-3b89b61a2870] Received event network-vif-deleted-39efb8fb-4ce5-4974-a7bc-6026f9c7ecfd {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:33 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:12:33 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:12:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:33 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Deleted allocations for instance d66f2088-97a5-4fff-9c0c-3b89b61a2870
Nov 14 19:12:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-081f7895-740a-4381-8147-b914a94b049d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "d66f2088-97a5-4fff-9c0c-3b89b61a2870" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.581s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:33 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:12:33 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:12:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "622d19bf-0618-49a9-9f71-b632d9e11301" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:39 user nova-compute[75205]: INFO nova.compute.manager [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Terminating instance
Nov 14 19:12:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-78564936-56fe-4636-adfe-37cef5e72d7f req-440901e9-f4b0-42b9-9fcc-7550dd244d39 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-vif-unplugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-78564936-56fe-4636-adfe-37cef5e72d7f req-440901e9-f4b0-42b9-9fcc-7550dd244d39 service nova] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-78564936-56fe-4636-adfe-37cef5e72d7f req-440901e9-f4b0-42b9-9fcc-7550dd244d39 service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-78564936-56fe-4636-adfe-37cef5e72d7f req-440901e9-f4b0-42b9-9fcc-7550dd244d39 service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-78564936-56fe-4636-adfe-37cef5e72d7f req-440901e9-f4b0-42b9-9fcc-7550dd244d39 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] No waiting events found dispatching network-vif-unplugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-78564936-56fe-4636-adfe-37cef5e72d7f req-440901e9-f4b0-42b9-9fcc-7550dd244d39 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-vif-unplugged-7fc6ede6-60c6-4440-a719-9397a8437fbb for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Instance destroyed successfully.
Nov 14 19:12:40 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lazy-loading 'resources' on Instance uuid 622d19bf-0618-49a9-9f71-b632d9e11301 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-502671428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-266304409',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuroo777PzrJhNT1Z+8Bz3bmZfqCc+/PXCXIZcuctFMhrY1Rpfi1QfSM9QpIJtELl/C4MHfcfyzeOJ7oaOGYkNsgfsiChX3EizTbvsbrCm3XCIgNnKEPubgbl6oglzwDw==',key_name='tempest-keypair-1647726640',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3325c3ab571b451da9cffb93069482f5',ramdisk_id='',reservation_id='r-7uy2l8c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-667072902',owner_user_name='tempest-ServerActionsV293TestJSON-667072902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11e8a4105e694b14b530792142351388',uuid=622d19bf-0618-49a9-9f71-b632d9e11301,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converting VIF {"id": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "address": "fa:16:3e:2f:65:53", "network": {"id": "4dec176e-83bf-48c7-849f-5e3a603b52ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-415475391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3325c3ab571b451da9cffb93069482f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fc6ede6-60", "ovs_interfaceid": "7fc6ede6-60c6-4440-a719-9397a8437fbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_vif [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fc6ede6-60, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9275a45-afa1-4b67-8706-a8e9941c8831) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:40 user nova-compute[75205]: INFO os_vif [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:65:53,bridge_name='br-int',has_traffic_filtering=True,id=7fc6ede6-60c6-4440-a719-9397a8437fbb,network=Network(4dec176e-83bf-48c7-849f-5e3a603b52ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fc6ede6-60')
Nov 14 19:12:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epHdMIaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:12:40 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e819f7e-5ebe-429e-88a3-4d80d759c51a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:12:40 user nova-compute[75205]: No targets found.
Nov 14 19:12:40 user nova-compute[75205]: iSNS:
Nov 14 19:12:40 user nova-compute[75205]: No targets found.
Nov 14 19:12:40 user nova-compute[75205]: STATIC:
Nov 14 19:12:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759
Nov 14 19:12:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1
Nov 14 19:12:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4
Nov 14 19:12:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:12:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76
Nov 14 19:12:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e
Nov 14 19:12:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:12:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:12:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:12:40 user nova-compute[75205]: FIRMWARE:
Nov 14 19:12:40 user nova-compute[75205]: No targets found.
Nov 14 19:12:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:12:40 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:12:40 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b657e68c-aa62-4afb-83ff-36e0a2ff5eb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[41346677-10e0-4cc0-9da4-cc9998fb9d9e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:12:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7410b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[205943dd-c754-4f95-acb6-5e0d26f849ab]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[723be98a-b248-4ac5-9b41-c16f7e2c5454]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[459a95cf-1e8f-41e3-8fce-a9e9769b4bd6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600bed8-f7bf-4eeb-82eb-dbb0e02e150e]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dbdfbf-c444-47d3-813f-f337a4a81549]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6000b903-034b-41a2-9fd8-e0f30c49f097]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260]
Nov 14 19:12:40 user nova-compute[75205]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76, portal: 172.16.0.220,3260] successful.
Nov 14 19:12:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e65258-d6ca-4db1-8633-f8f45aa20d76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c87a43-2283-4762-b9d1-3e502c69fe54]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] <== disconnect_volume: return (423ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:12:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Deleting instance files /opt/stack/data/nova/instances/622d19bf-0618-49a9-9f71-b632d9e11301_del
Nov 14 19:12:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Deletion of /opt/stack/data/nova/instances/622d19bf-0618-49a9-9f71-b632d9e11301_del complete
Nov 14 19:12:40 user nova-compute[75205]: INFO nova.compute.manager [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 14 19:12:40 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:12:40 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:12:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-2372da54-1850-43e5-8d1a-792eacb66b79 req-fe798342-7210-4735-87f5-526978755456 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2372da54-1850-43e5-8d1a-792eacb66b79 req-fe798342-7210-4735-87f5-526978755456 service nova] Acquiring lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2372da54-1850-43e5-8d1a-792eacb66b79 req-fe798342-7210-4735-87f5-526978755456 service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2372da54-1850-43e5-8d1a-792eacb66b79 req-fe798342-7210-4735-87f5-526978755456 service nova] Lock "622d19bf-0618-49a9-9f71-b632d9e11301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-2372da54-1850-43e5-8d1a-792eacb66b79 req-fe798342-7210-4735-87f5-526978755456 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] No waiting events found dispatching network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:41 user nova-compute[75205]: WARNING nova.compute.manager [req-2372da54-1850-43e5-8d1a-792eacb66b79 req-fe798342-7210-4735-87f5-526978755456 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received unexpected event network-vif-plugged-7fc6ede6-60c6-4440-a719-9397a8437fbb for instance with vm_state active and task_state deleting.
Nov 14 19:12:42 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-220cbdff-2f9b-47c8-9cbf-9f60db0ae282 req-5221d16d-1d09-4b04-bc90-eb660ff862d6 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Received event network-vif-deleted-7fc6ede6-60c6-4440-a719-9397a8437fbb {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:42 user nova-compute[75205]: INFO nova.compute.manager [req-220cbdff-2f9b-47c8-9cbf-9f60db0ae282 req-5221d16d-1d09-4b04-bc90-eb660ff862d6 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Neutron deleted interface 7fc6ede6-60c6-4440-a719-9397a8437fbb; detaching it from the instance and deleting it from the info cache
Nov 14 19:12:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-220cbdff-2f9b-47c8-9cbf-9f60db0ae282 req-5221d16d-1d09-4b04-bc90-eb660ff862d6 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:42 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Took 1.42 seconds to deallocate network for instance.
Nov 14 19:12:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-220cbdff-2f9b-47c8-9cbf-9f60db0ae282 req-5221d16d-1d09-4b04-bc90-eb660ff862d6 service nova] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Detach interface failed, port_id=7fc6ede6-60c6-4440-a719-9397a8437fbb, reason: Instance 622d19bf-0618-49a9-9f71-b632d9e11301 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:12:42 user nova-compute[75205]: INFO nova.compute.manager [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 19:12:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] [instance: 622d19bf-0618-49a9-9f71-b632d9e11301] Deleting volume: 77e65258-d6ca-4db1-8633-f8f45aa20d76 {{(pid=75205) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 19:12:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:43 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:12:43 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:12:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:43 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Deleted allocations for instance 622d19bf-0618-49a9-9f71-b632d9e11301
Nov 14 19:12:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3116d59d-58a2-4011-b2fa-457e41d91196 tempest-ServerActionsV293TestJSON-667072902 tempest-ServerActionsV293TestJSON-667072902-project-member] Lock "622d19bf-0618-49a9-9f71-b632d9e11301" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.162s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:48 user nova-compute[75205]: INFO nova.compute.manager [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Terminating instance
Nov 14 19:12:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:12:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-59b79657-8bf3-4378-a76f-55a6010d8c2b req-2c48bead-f15d-45ff-8e3a-75f5ec4a021c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received event network-vif-unplugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-59b79657-8bf3-4378-a76f-55a6010d8c2b req-2c48bead-f15d-45ff-8e3a-75f5ec4a021c service nova] Acquiring lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-59b79657-8bf3-4378-a76f-55a6010d8c2b req-2c48bead-f15d-45ff-8e3a-75f5ec4a021c service nova] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-59b79657-8bf3-4378-a76f-55a6010d8c2b req-2c48bead-f15d-45ff-8e3a-75f5ec4a021c service nova] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-59b79657-8bf3-4378-a76f-55a6010d8c2b req-2c48bead-f15d-45ff-8e3a-75f5ec4a021c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] No waiting events found dispatching network-vif-unplugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-59b79657-8bf3-4378-a76f-55a6010d8c2b req-2c48bead-f15d-45ff-8e3a-75f5ec4a021c service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received event network-vif-unplugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:12:49 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Instance destroyed successfully.
Nov 14 19:12:49 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lazy-loading 'resources' on Instance uuid 26a6a013-500d-4502-a9f1-cffef3c4ba27 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-221337393',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-221337393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2213373',id=11,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9UZsuGYmLqPDuQ/bD6c2As4gMKwpFHCTosimF+Xvt4HdB1mNyK+JVEVQzbVKvXifcTuJHUvvp5Dmx5NOGouBlizROs7gBkQg3Ww7o4M1Zr4igf4DvqypsYh4V3B7k6DA==',key_name='tempest-keypair-702390106',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6be48693253e4be8989e5ddb7ddda587',ramdisk_id='',reservation_id='r-74d9x4gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-412054473',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:10:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00affbfeb9df44da953130a4ca8f3969',uuid=26a6a013-500d-4502-a9f1-cffef3c4ba27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Converting VIF {"id": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "address": "fa:16:3e:e3:cb:d7", "network": {"id": "f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-823427772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be48693253e4be8989e5ddb7ddda587", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084929fe-e9", "ovs_interfaceid": "084929fe-e98b-437e-8bbd-4b3c0ec7d97a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=084929fe-e98b-437e-8bbd-4b3c0ec7d97a,network=Network(f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084929fe-e9') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG os_vif [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=084929fe-e98b-437e-8bbd-4b3c0ec7d97a,network=Network(f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084929fe-e9') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap084929fe-e9, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b0ee26b-cdaf-4005-9db4-deb5b19fc3d6) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:12:49 user nova-compute[75205]: INFO os_vif [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:cb:d7,bridge_name='br-int',has_traffic_filtering=True,id=084929fe-e98b-437e-8bbd-4b3c0ec7d97a,network=Network(f82aa6ca-c5aa-4b07-80e4-e9be79a6c75b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084929fe-e9')
Nov 14 19:12:49 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Deleting instance files /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27_del
Nov 14 19:12:49 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Deletion of /opt/stack/data/nova/instances/26a6a013-500d-4502-a9f1-cffef3c4ba27_del complete
Nov 14 19:12:49 user nova-compute[75205]: INFO nova.compute.manager [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 19:12:49 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:12:49 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:12:50 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:12:50 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Took 0.74 seconds to deallocate network for instance.
Nov 14 19:12:50 user nova-compute[75205]: DEBUG nova.compute.manager [req-2ea2ae74-0c67-4ee6-a64c-659c805dbd50 req-18f4edba-a0a4-49ca-bbdf-b48b7b8c6e7e service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received event network-vif-deleted-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:50 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:12:50 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:12:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:51 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Deleted allocations for instance 26a6a013-500d-4502-a9f1-cffef3c4ba27
Nov 14 19:12:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9a4b779e-ce3a-4ecd-bce2-1c2d0fd7f174 tempest-TestServerVolumeAttachScenarioOldVersion-412054473 tempest-TestServerVolumeAttachScenarioOldVersion-412054473-project-member] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.289s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-ecbd072d-a603-47e2-90c3-f5750afd7333 req-84925c1e-e6a0-4b76-b7df-34699a933895 service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received event network-vif-plugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:12:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ecbd072d-a603-47e2-90c3-f5750afd7333 req-84925c1e-e6a0-4b76-b7df-34699a933895 service nova] Acquiring lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:12:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ecbd072d-a603-47e2-90c3-f5750afd7333 req-84925c1e-e6a0-4b76-b7df-34699a933895 service nova] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:12:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ecbd072d-a603-47e2-90c3-f5750afd7333 req-84925c1e-e6a0-4b76-b7df-34699a933895 service nova] Lock "26a6a013-500d-4502-a9f1-cffef3c4ba27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:12:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-ecbd072d-a603-47e2-90c3-f5750afd7333 req-84925c1e-e6a0-4b76-b7df-34699a933895 service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] No waiting events found dispatching network-vif-plugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:12:51 user nova-compute[75205]: WARNING nova.compute.manager [req-ecbd072d-a603-47e2-90c3-f5750afd7333 req-84925c1e-e6a0-4b76-b7df-34699a933895 service nova] [instance: 26a6a013-500d-4502-a9f1-cffef3c4ba27] Received unexpected event network-vif-plugged-084929fe-e98b-437e-8bbd-4b3c0ec7d97a for instance with vm_state deleted and task_state None.
Nov 14 19:12:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:12:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:06 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:13:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:13:07 user nova-compute[75205]: INFO nova.compute.claims [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Claim successful on node user
Nov 14 19:13:07 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:13:07 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 19:13:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG nova.policy [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '605afe1a09b546d386a7603cb312f6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6489560619f64a12987762b7b5fcfb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:13:07 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Creating image(s)
Nov 14 19:13:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "/opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "/opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "55c23c2189cbdd72f222fd91a30b32a3da9f65dc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "55c23c2189cbdd72f222fd91a30b32a3da9f65dc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc.part --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG nova.virt.images [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] 20040111-72c4-4d5f-898b-8201eb2febdd was qcow2, converting to raw {{(pid=75205) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc.part /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc.converted {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Successfully created port: 38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc.part /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc.converted" returned: 0 in 0.130s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc.converted --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "55c23c2189cbdd72f222fd91a30b32a3da9f65dc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.897s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "55c23c2189cbdd72f222fd91a30b32a3da9f65dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "55c23c2189cbdd72f222fd91a30b32a3da9f65dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Successfully updated port: 38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "refresh_cache-cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquired lock "refresh_cache-cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-0bb3a18f-47c5-4c51-9f88-7360b59f961c req-e2821348-4a64-432d-beaf-ece49b69345e service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received event network-changed-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-0bb3a18f-47c5-4c51-9f88-7360b59f961c req-e2821348-4a64-432d-beaf-ece49b69345e service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Refreshing instance network info cache due to event network-changed-38be7883-5d11-431e-8a4c-7d70b2839e88. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0bb3a18f-47c5-4c51-9f88-7360b59f961c req-e2821348-4a64-432d-beaf-ece49b69345e service nova] Acquiring lock "refresh_cache-cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:13:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc,backing_fmt=raw /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc,backing_fmt=raw /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk 1073741824" returned: 0 in 0.053s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "55c23c2189cbdd72f222fd91a30b32a3da9f65dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc --force-share --output=json" returned: 0 in 0.309s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Cannot resize image /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Ensure instance console log exists: /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Updating instance_info_cache with network_info: [{"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Releasing lock "refresh_cache-cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Instance network_info: |[{"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0bb3a18f-47c5-4c51-9f88-7360b59f961c req-e2821348-4a64-432d-beaf-ece49b69345e service nova] Acquired lock "refresh_cache-cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.network.neutron [req-0bb3a18f-47c5-4c51-9f88-7360b59f961c req-e2821348-4a64-432d-beaf-ece49b69345e service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Refreshing network info cache for port 38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Start _get_guest_xml network_info=[{"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:13:02Z,direct_url=<?>,disk_format='qcow2',id=20040111-72c4-4d5f-898b-8201eb2febdd,min_disk=0,min_ram=0,name='',owner='94dd8640a1514a92a5fe8e7a90d41c5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '20040111-72c4-4d5f-898b-8201eb2febdd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:13:09 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:13:09 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:13:02Z,direct_url=<?>,disk_format='qcow2',id=20040111-72c4-4d5f-898b-8201eb2febdd,min_disk=0,min_ram=0,name='',owner='94dd8640a1514a92a5fe8e7a90d41c5e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1959790396',display_name='tempest-AttachSCSIVolumeTestJSON-server-1959790396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1959790396',id=18,image_ref='20040111-72c4-4d5f-898b-8201eb2febdd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAsg8UJFTQgzDBdXFl09Kgbs3mOFM5tOlCMLdylclQUCofkSOYuUx+ETvwit7FYkMWjI0QmSd9QKdPbLbZybqF/h6CbpcT7zbLE7/6B3KjKgun9uTxo/NzgPd3bkTR+aA==',key_name='tempest-keypair-888737085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6489560619f64a12987762b7b5fcfb2a',ramdisk_id='',reservation_id='r-oc3kqz8k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='20040111-72c4-4d5f-898b-8201eb2febdd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1705157206',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1705157206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='605afe1a09b546d386a7603cb312f6b0',uuid=cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Converting VIF {"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:79:8f,bridge_name='br-int',has_traffic_filtering=True,id=38be7883-5d11-431e-8a4c-7d70b2839e88,network=Network(46ab4507-e45f-4763-bf0b-59c44d8b6dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38be7883-5d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lazy-loading 'pci_devices' on Instance uuid cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:13:09 user nova-compute[75205]:   <uuid>cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c</uuid>
Nov 14 19:13:09 user nova-compute[75205]:   <name>instance-00000012</name>
Nov 14 19:13:09 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:13:09 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:13:09 user nova-compute[75205]:   <metadata>
Nov 14 19:13:09 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:13:09 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:13:09 user nova-compute[75205]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1959790396</nova:name>
Nov 14 19:13:09 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:13:09</nova:creationTime>
Nov 14 19:13:09 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:13:09 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:13:09 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:13:09 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:13:09 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:13:09 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:13:09 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:13:09 user nova-compute[75205]:       <nova:owner>
Nov 14 19:13:09 user nova-compute[75205]:         <nova:user uuid="605afe1a09b546d386a7603cb312f6b0">tempest-AttachSCSIVolumeTestJSON-1705157206-project-member</nova:user>
Nov 14 19:13:09 user nova-compute[75205]:         <nova:project uuid="6489560619f64a12987762b7b5fcfb2a">tempest-AttachSCSIVolumeTestJSON-1705157206</nova:project>
Nov 14 19:13:09 user nova-compute[75205]:       </nova:owner>
Nov 14 19:13:09 user nova-compute[75205]:       <nova:root type="image" uuid="20040111-72c4-4d5f-898b-8201eb2febdd"/>
Nov 14 19:13:09 user nova-compute[75205]:       <nova:ports>
Nov 14 19:13:09 user nova-compute[75205]:         <nova:port uuid="38be7883-5d11-431e-8a4c-7d70b2839e88">
Nov 14 19:13:09 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 19:13:09 user nova-compute[75205]:         </nova:port>
Nov 14 19:13:09 user nova-compute[75205]:       </nova:ports>
Nov 14 19:13:09 user nova-compute[75205]:     </nova:instance>
Nov 14 19:13:09 user nova-compute[75205]:   </metadata>
Nov 14 19:13:09 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:13:09 user nova-compute[75205]:     <system>
Nov 14 19:13:09 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:13:09 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:13:09 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:13:09 user nova-compute[75205]:       <entry name="serial">cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c</entry>
Nov 14 19:13:09 user nova-compute[75205]:       <entry name="uuid">cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c</entry>
Nov 14 19:13:09 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:13:09 user nova-compute[75205]:     </system>
Nov 14 19:13:09 user nova-compute[75205]:   </sysinfo>
Nov 14 19:13:09 user nova-compute[75205]:   <os>
Nov 14 19:13:09 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:13:09 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:13:09 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:13:09 user nova-compute[75205]:   </os>
Nov 14 19:13:09 user nova-compute[75205]:   <features>
Nov 14 19:13:09 user nova-compute[75205]:     <acpi/>
Nov 14 19:13:09 user nova-compute[75205]:     <apic/>
Nov 14 19:13:09 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:13:09 user nova-compute[75205]:   </features>
Nov 14 19:13:09 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:13:09 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:13:09 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:13:09 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:13:09 user nova-compute[75205]:   </clock>
Nov 14 19:13:09 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:13:09 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:13:09 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:13:09 user nova-compute[75205]:   </cpu>
Nov 14 19:13:09 user nova-compute[75205]:   <devices>
Nov 14 19:13:09 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:13:09 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:13:09 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk"/>
Nov 14 19:13:09 user nova-compute[75205]:       <target dev="sda" bus="scsi"/>
Nov 14 19:13:09 user nova-compute[75205]:       <address type="drive" controller="0" unit="0"/>
Nov 14 19:13:09 user nova-compute[75205]:     </disk>
Nov 14 19:13:09 user nova-compute[75205]:     <disk type="file" device="cdrom">
Nov 14 19:13:09 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 19:13:09 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk.config"/>
Nov 14 19:13:09 user nova-compute[75205]:       <target dev="sdb" bus="scsi"/>
Nov 14 19:13:09 user nova-compute[75205]:       <address type="drive" controller="0" unit="1"/>
Nov 14 19:13:09 user nova-compute[75205]:     </disk>
Nov 14 19:13:09 user nova-compute[75205]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 19:13:09 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:13:09 user nova-compute[75205]:       <mac address="fa:16:3e:0a:79:8f"/>
Nov 14 19:13:09 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:13:09 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:13:09 user nova-compute[75205]:       <target dev="tap38be7883-5d"/>
Nov 14 19:13:09 user nova-compute[75205]:     </interface>
Nov 14 19:13:09 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:13:09 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/console.log" append="off"/>
Nov 14 19:13:09 user nova-compute[75205]:     </serial>
Nov 14 19:13:09 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:13:09 user nova-compute[75205]:     <video>
Nov 14 19:13:09 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:13:09 user nova-compute[75205]:     </video>
Nov 14 19:13:09 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:13:09 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:13:09 user nova-compute[75205]:     </rng>
Nov 14 19:13:09 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:13:09 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:13:09 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:13:09 user nova-compute[75205]:     </memballoon>
Nov 14 19:13:09 user nova-compute[75205]:   </devices>
Nov 14 19:13:09 user nova-compute[75205]: </domain>
Nov 14 19:13:09 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1959790396',display_name='tempest-AttachSCSIVolumeTestJSON-server-1959790396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1959790396',id=18,image_ref='20040111-72c4-4d5f-898b-8201eb2febdd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAsg8UJFTQgzDBdXFl09Kgbs3mOFM5tOlCMLdylclQUCofkSOYuUx+ETvwit7FYkMWjI0QmSd9QKdPbLbZybqF/h6CbpcT7zbLE7/6B3KjKgun9uTxo/NzgPd3bkTR+aA==',key_name='tempest-keypair-888737085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6489560619f64a12987762b7b5fcfb2a',ramdisk_id='',reservation_id='r-oc3kqz8k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='20040111-72c4-4d5f-898b-8201eb2febdd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1705157206',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1705157206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='605afe1a09b546d386a7603cb312f6b0',uuid=cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Converting VIF {"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:79:8f,bridge_name='br-int',has_traffic_filtering=True,id=38be7883-5d11-431e-8a4c-7d70b2839e88,network=Network(46ab4507-e45f-4763-bf0b-59c44d8b6dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38be7883-5d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG os_vif [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:79:8f,bridge_name='br-int',has_traffic_filtering=True,id=38be7883-5d11-431e-8a4c-7d70b2839e88,network=Network(46ab4507-e45f-4763-bf0b-59c44d8b6dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38be7883-5d') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0c7ec07-3db8-56df-ba2c-4056e0fa145c', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38be7883-5d, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38be7883-5d, col_values=(('qos', UUID('5ad01cde-11f3-49f0-8683-4d8a4e319382')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38be7883-5d, col_values=(('external_ids', {'iface-id': '38be7883-5d11-431e-8a4c-7d70b2839e88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:79:8f', 'vm-uuid': 'cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:09 user nova-compute[75205]: INFO os_vif [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:79:8f,bridge_name='br-int',has_traffic_filtering=True,id=38be7883-5d11-431e-8a4c-7d70b2839e88,network=Network(46ab4507-e45f-4763-bf0b-59c44d8b6dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38be7883-5d')
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] No BDM found with device name sda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] No VIF found with MAC fa:16:3e:0a:79:8f, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:13:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Using config drive
Nov 14 19:13:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Creating config drive at /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk.config
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpup8z4dul {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpup8z4dul" returned: 0 in 0.053s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.network.neutron [req-0bb3a18f-47c5-4c51-9f88-7360b59f961c req-e2821348-4a64-432d-beaf-ece49b69345e service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Updated VIF entry in instance network info cache for port 38be7883-5d11-431e-8a4c-7d70b2839e88. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:13:09 user nova-compute[75205]: DEBUG nova.network.neutron [req-0bb3a18f-47c5-4c51-9f88-7360b59f961c req-e2821348-4a64-432d-beaf-ece49b69345e service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Updating instance_info_cache with network_info: [{"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0bb3a18f-47c5-4c51-9f88-7360b59f961c req-e2821348-4a64-432d-beaf-ece49b69345e service nova] Releasing lock "refresh_cache-cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:13:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:10 user nova-compute[75205]: INFO nova.compute.manager [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Rescuing
Nov 14 19:13:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:13:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquired lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:13:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG nova.network.neutron [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updating instance_info_cache with network_info: [{"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Releasing lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-eac2f095-156c-453d-95d3-7366a74c52c0 req-18147d4d-cee1-4316-b8df-9cbbfa57ea63 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-unplugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eac2f095-156c-453d-95d3-7366a74c52c0 req-18147d4d-cee1-4316-b8df-9cbbfa57ea63 service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eac2f095-156c-453d-95d3-7366a74c52c0 req-18147d4d-cee1-4316-b8df-9cbbfa57ea63 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eac2f095-156c-453d-95d3-7366a74c52c0 req-18147d4d-cee1-4316-b8df-9cbbfa57ea63 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-eac2f095-156c-453d-95d3-7366a74c52c0 req-18147d4d-cee1-4316-b8df-9cbbfa57ea63 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-unplugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:12 user nova-compute[75205]: WARNING nova.compute.manager [req-eac2f095-156c-453d-95d3-7366a74c52c0 req-18147d4d-cee1-4316-b8df-9cbbfa57ea63 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-unplugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state active and task_state rescuing.
Nov 14 19:13:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Instance destroyed successfully.
Nov 14 19:13:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Attempting a stable device rescue
Nov 14 19:13:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75205) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Instance directory exists: not creating {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 19:13:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Creating image(s)
Nov 14 19:13:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "/opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "/opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "/opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG nova.objects.instance [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'trusted_certs' on Instance uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "0b10fa9bd5166603ea168d7fa6adf95cb8fea180" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "0b10fa9bd5166603ea168d7fa6adf95cb8fea180" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180.part --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-331f5f72-9314-4413-bdb5-c56bfd62e5b5 req-f1b8ed8a-7bd4-4b77-9c7f-d2a3ffb21af3 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received event network-vif-plugged-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-331f5f72-9314-4413-bdb5-c56bfd62e5b5 req-f1b8ed8a-7bd4-4b77-9c7f-d2a3ffb21af3 service nova] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-331f5f72-9314-4413-bdb5-c56bfd62e5b5 req-f1b8ed8a-7bd4-4b77-9c7f-d2a3ffb21af3 service nova] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-331f5f72-9314-4413-bdb5-c56bfd62e5b5 req-f1b8ed8a-7bd4-4b77-9c7f-d2a3ffb21af3 service nova] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-331f5f72-9314-4413-bdb5-c56bfd62e5b5 req-f1b8ed8a-7bd4-4b77-9c7f-d2a3ffb21af3 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] No waiting events found dispatching network-vif-plugged-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:13 user nova-compute[75205]: WARNING nova.compute.manager [req-331f5f72-9314-4413-bdb5-c56bfd62e5b5 req-f1b8ed8a-7bd4-4b77-9c7f-d2a3ffb21af3 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received unexpected event network-vif-plugged-38be7883-5d11-431e-8a4c-7d70b2839e88 for instance with vm_state building and task_state spawning.
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:13:13 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Instance spawned successfully.
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:13:13 user nova-compute[75205]: INFO nova.compute.manager [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.virt.images [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] 650da000-e62f-43f4-9dd8-9d963c791cfe was qcow2, converting to raw {{(pid=75205) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:13:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180.part /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180.converted {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:13 user nova-compute[75205]: INFO nova.compute.manager [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Took 7.00 seconds to build instance.
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b67af83-8799-4a37-969e-c25f1cb1b5b6 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.228s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180.part /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180.converted" returned: 0 in 0.199s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180.converted --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-91f7c939-d5e5-4cc5-97c0-88963ae85903 req-f19c8c89-925b-4bf3-9227-ba1e7d98f9c0 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91f7c939-d5e5-4cc5-97c0-88963ae85903 req-f19c8c89-925b-4bf3-9227-ba1e7d98f9c0 service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91f7c939-d5e5-4cc5-97c0-88963ae85903 req-f19c8c89-925b-4bf3-9227-ba1e7d98f9c0 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91f7c939-d5e5-4cc5-97c0-88963ae85903 req-f19c8c89-925b-4bf3-9227-ba1e7d98f9c0 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-91f7c939-d5e5-4cc5-97c0-88963ae85903 req-f19c8c89-925b-4bf3-9227-ba1e7d98f9c0 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:14 user nova-compute[75205]: WARNING nova.compute.manager [req-91f7c939-d5e5-4cc5-97c0-88963ae85903 req-f19c8c89-925b-4bf3-9227-ba1e7d98f9c0 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state active and task_state rescuing.
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "0b10fa9bd5166603ea168d7fa6adf95cb8fea180" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.670s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "0b10fa9bd5166603ea168d7fa6adf95cb8fea180" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "0b10fa9bd5166603ea168d7fa6adf95cb8fea180" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180 --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180 --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180,backing_fmt=raw /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180,backing_fmt=raw /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue" returned: 0 in 0.046s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "0b10fa9bd5166603ea168d7fa6adf95cb8fea180" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.objects.instance [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'migration_context' on Instance uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.objects.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Object Instance<d453ca1b-600f-40a9-9478-60ae619302ca> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Start _get_guest_xml network_info=[{"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "vif_mac": "fa:16:3e:02:4e:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '650da000-e62f-43f4-9dd8-9d963c791cfe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELZUBViw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd453ca1b-600f-40a9-9478-60ae619302ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'd62c2b92-9d2a-4d53-a265-ff059dab8844', 'serial': 'd62c2b92-9d2a-4d53-a265-ff059dab8844'}, 'attachment_id': 'a3d1b551-6d6e-4c2b-a7d5-f35574e4b3ed', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.objects.instance [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'resources' on Instance uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.objects.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Object Instance<d453ca1b-600f-40a9-9478-60ae619302ca> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.objects.instance [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'numa_topology' on Instance uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.objects.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Object Instance<d453ca1b-600f-40a9-9478-60ae619302ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:13:14 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:13:14 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.objects.instance [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'vcpu_model' on Instance uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.objects.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Object Instance<d453ca1b-600f-40a9-9478-60ae619302ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELZUBViw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:13:14 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:13:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:13:14 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:13:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:13:14 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:13:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0860656a-765d-4e0a-b24c-91e566e724db]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ELZUBViw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 19:13:14 user nova-compute[75205]: node.name = iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:13:14 user nova-compute[75205]: node.tpgt = -1
Nov 14 19:13:14 user nova-compute[75205]: node.startup = automatic
Nov 14 19:13:14 user nova-compute[75205]: node.leading_login = No
Nov 14 19:13:14 user nova-compute[75205]: iface.iscsi_ifacename = default
Nov 14 19:13:14 user nova-compute[75205]: iface.net_ifacename = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.ipaddress = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.prefix_len = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.hwaddress = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.transport_name = tcp
Nov 14 19:13:14 user nova-compute[75205]: iface.initiatorname = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.state = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.vlan_id = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.vlan_priority = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.vlan_state = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.iface_num = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.mtu = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.port = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.bootproto = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.subnet_mask = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.gateway = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.dhcp_alt_client_id = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.dhcp_dns = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.dhcp_learn_iqn = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.dhcp_vendor_id_state = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.dhcp_vendor_id = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.dhcp_slp_da = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.fragmentation = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.gratuitous_arp = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.incoming_forwarding = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.tos_state = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.tos = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.ttl = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.delayed_ack = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.tcp_nagle = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.tcp_wsf_state = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.tcp_wsf = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.tcp_timer_scale = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.tcp_timestamp = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.redirect = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.def_task_mgmt_timeout = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.header_digest = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.data_digest = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.immediate_data = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.initial_r2t = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.data_seq_inorder = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.data_pdu_inorder = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.erl = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.max_receive_data_len = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.first_burst_len = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.max_outstanding_r2t = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.max_burst_len = 0
Nov 14 19:13:14 user nova-compute[75205]: iface.chap_auth = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.bidi_chap = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.strict_login_compliance = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.discovery_auth = <empty>
Nov 14 19:13:14 user nova-compute[75205]: iface.discovery_logout = <empty>
Nov 14 19:13:14 user nova-compute[75205]: node.discovery_address = <empty>
Nov 14 19:13:14 user nova-compute[75205]: node.discovery_port = 0
Nov 14 19:13:14 user nova-compute[75205]: node.discovery_type = static
Nov 14 19:13:14 user nova-compute[75205]: node.session.initial_cmdsn = 0
Nov 14 19:13:14 user nova-compute[75205]: node.session.initial_login_retry_max = 8
Nov 14 19:13:14 user nova-compute[75205]: node.session.xmit_thread_priority = -20
Nov 14 19:13:14 user nova-compute[75205]: node.session.cmds_max = 128
Nov 14 19:13:14 user nova-compute[75205]: node.session.queue_depth = 32
Nov 14 19:13:14 user nova-compute[75205]: node.session.nr_sessions = 1
Nov 14 19:13:14 user nova-compute[75205]: node.session.auth.authmethod = CHAP
Nov 14 19:13:14 user nova-compute[75205]: node.session.auth.username = ELZUBViw
Nov 14 19:13:14 user nova-compute[75205]: node.session.auth.password = ***
Nov 14 19:13:14 user nova-compute[75205]: node.session.auth.username_in = <empty>
Nov 14 19:13:14 user nova-compute[75205]: node.session.auth.password_in = <empty>
Nov 14 19:13:14 user nova-compute[75205]: node.session.auth.chap_algs = MD5
Nov 14 19:13:14 user nova-compute[75205]: node.session.timeo.replacement_timeout = 120
Nov 14 19:13:14 user nova-compute[75205]: node.session.err_timeo.abort_timeout = 15
Nov 14 19:13:14 user nova-compute[75205]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 19:13:14 user nova-compute[75205]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 19:13:14 user nova-compute[75205]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 19:13:14 user nova-compute[75205]: node.session.iscsi.FastAbort = Yes
Nov 14 19:13:14 user nova-compute[75205]: node.session.iscsi.InitialR2T = No
Nov 14 19:13:14 user nova-compute[75205]: node.session.iscsi.ImmediateData = Yes
Nov 14 19:13:14 user nova-compute[75205]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 19:13:14 user nova-compute[75205]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 19:13:14 user nova-compute[75205]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 19:13:14 user nova-compute[75205]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 19:13:14 user nova-compute[75205]: node.session.iscsi.MaxConnections = 1
Nov 14 19:13:14 user nova-compute[75205]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 19:13:14 user nova-compute[75205]: node.session.iscsi.ERL = 0
Nov 14 19:13:14 user nova-compute[75205]: node.session.scan = manual
Nov 14 19:13:14 user nova-compute[75205]: node.session.reopen_max = 0
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].address = 172.16.0.220
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].port = 3260
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].startup = manual
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].tcp.window_size = 524288
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].tcp.type_of_service = 0
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].timeo.logout_timeout = 15
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].timeo.login_timeout = 15
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].timeo.auth_timeout = 45
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].iscsi.DataDigest = None
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].iscsi.IFMarker = No
Nov 14 19:13:14 user nova-compute[75205]: node.conn[0].iscsi.OFMarker = No
Nov 14 19:13:14 user nova-compute[75205]: # END RECORD
Nov 14 19:13:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69bcfa8-0243-441d-aae1-81bded3fd95e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.088s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a76834-9322-4664-8139-7b9915196989]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELZUBViw {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.compute.manager [req-54965838-023b-49cd-b30a-1ffc5dd76c7e req-e582cd8d-aec9-42c8-8453-e1d5162c8c17 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received event network-vif-plugged-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-54965838-023b-49cd-b30a-1ffc5dd76c7e req-e582cd8d-aec9-42c8-8453-e1d5162c8c17 service nova] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-54965838-023b-49cd-b30a-1ffc5dd76c7e req-e582cd8d-aec9-42c8-8453-e1d5162c8c17 service nova] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-54965838-023b-49cd-b30a-1ffc5dd76c7e req-e582cd8d-aec9-42c8-8453-e1d5162c8c17 service nova] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.compute.manager [req-54965838-023b-49cd-b30a-1ffc5dd76c7e req-e582cd8d-aec9-42c8-8453-e1d5162c8c17 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] No waiting events found dispatching network-vif-plugged-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:15 user nova-compute[75205]: WARNING nova.compute.manager [req-54965838-023b-49cd-b30a-1ffc5dd76c7e req-e582cd8d-aec9-42c8-8453-e1d5162c8c17 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received unexpected event network-vif-plugged-38be7883-5d11-431e-8a4c-7d70b2839e88 for instance with vm_state active and task_state None.
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELZUBViw" returned: 0 in 0.120s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc322d1-67c4-4fbc-a793-fb54587284ab]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELZUBViw'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0755f69-7717-4f6f-8f6d-ad9861fd8c81]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e40c561-36fb-4118-bd51-ce69259fe48e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:15 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:13:15 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:15 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:15 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:15 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:13:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:15 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:13:15 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:15 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:15 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:15 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:13:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[517db30f-2483-4bf1-a44c-775c090e5485]: (4, ('0 0 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELZUBViw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.475s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] <== connect_volume: return (476ms) {'type': 'block', 'scsi_wwn': '26665633466663030', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665633466663030', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2107882720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2107882720',id=13,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:11:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-nnfvmpga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:11:37Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=d453ca1b-600f-40a9-9478-60ae619302ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "vif_mac": "fa:16:3e:02:4e:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "vif_mac": "fa:16:3e:02:4e:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:4e:6d,bridge_name='br-int',has_traffic_filtering=True,id=5e1d6240-9d0b-4c83-9674-16d633e92bde,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1d6240-9d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'pci_devices' on Instance uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.objects.base [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Object Instance<d453ca1b-600f-40a9-9478-60ae619302ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:13:15 user nova-compute[75205]:   <uuid>d453ca1b-600f-40a9-9478-60ae619302ca</uuid>
Nov 14 19:13:15 user nova-compute[75205]:   <name>instance-0000000d</name>
Nov 14 19:13:15 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:13:15 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:13:15 user nova-compute[75205]:   <metadata>
Nov 14 19:13:15 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:13:15 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:13:15 user nova-compute[75205]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2107882720</nova:name>
Nov 14 19:13:15 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:13:14</nova:creationTime>
Nov 14 19:13:15 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:13:15 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:13:15 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:13:15 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:13:15 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:13:15 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:13:15 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:13:15 user nova-compute[75205]:       <nova:owner>
Nov 14 19:13:15 user nova-compute[75205]:         <nova:user uuid="d0ee9d2093e64175b45b3b4d99b5648f">tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member</nova:user>
Nov 14 19:13:15 user nova-compute[75205]:         <nova:project uuid="fde587867310451cab4f464b330555af">tempest-ServerBootFromVolumeStableRescueTest-2146587572</nova:project>
Nov 14 19:13:15 user nova-compute[75205]:       </nova:owner>
Nov 14 19:13:15 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:13:15 user nova-compute[75205]:       <nova:ports>
Nov 14 19:13:15 user nova-compute[75205]:         <nova:port uuid="5e1d6240-9d0b-4c83-9674-16d633e92bde">
Nov 14 19:13:15 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:13:15 user nova-compute[75205]:         </nova:port>
Nov 14 19:13:15 user nova-compute[75205]:       </nova:ports>
Nov 14 19:13:15 user nova-compute[75205]:     </nova:instance>
Nov 14 19:13:15 user nova-compute[75205]:   </metadata>
Nov 14 19:13:15 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:13:15 user nova-compute[75205]:     <system>
Nov 14 19:13:15 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:13:15 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:13:15 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:13:15 user nova-compute[75205]:       <entry name="serial">d453ca1b-600f-40a9-9478-60ae619302ca</entry>
Nov 14 19:13:15 user nova-compute[75205]:       <entry name="uuid">d453ca1b-600f-40a9-9478-60ae619302ca</entry>
Nov 14 19:13:15 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:13:15 user nova-compute[75205]:     </system>
Nov 14 19:13:15 user nova-compute[75205]:   </sysinfo>
Nov 14 19:13:15 user nova-compute[75205]:   <os>
Nov 14 19:13:15 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:13:15 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:13:15 user nova-compute[75205]:   </os>
Nov 14 19:13:15 user nova-compute[75205]:   <features>
Nov 14 19:13:15 user nova-compute[75205]:     <acpi/>
Nov 14 19:13:15 user nova-compute[75205]:     <apic/>
Nov 14 19:13:15 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:13:15 user nova-compute[75205]:   </features>
Nov 14 19:13:15 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:13:15 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:13:15 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:13:15 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:13:15 user nova-compute[75205]:   </clock>
Nov 14 19:13:15 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:13:15 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:13:15 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:13:15 user nova-compute[75205]:   </cpu>
Nov 14 19:13:15 user nova-compute[75205]:   <devices>
Nov 14 19:13:15 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:13:15 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:13:15 user nova-compute[75205]:       <source dev="/dev/sdb"/>
Nov 14 19:13:15 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:13:15 user nova-compute[75205]:       <serial>d62c2b92-9d2a-4d53-a265-ff059dab8844</serial>
Nov 14 19:13:15 user nova-compute[75205]:     </disk>
Nov 14 19:13:15 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:13:15 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:13:15 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue"/>
Nov 14 19:13:15 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:13:15 user nova-compute[75205]:       <boot order="1"/>
Nov 14 19:13:15 user nova-compute[75205]:     </disk>
Nov 14 19:13:15 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:13:15 user nova-compute[75205]:       <mac address="fa:16:3e:02:4e:6d"/>
Nov 14 19:13:15 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:13:15 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:13:15 user nova-compute[75205]:       <target dev="tap5e1d6240-9d"/>
Nov 14 19:13:15 user nova-compute[75205]:     </interface>
Nov 14 19:13:15 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:13:15 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/console.log" append="off"/>
Nov 14 19:13:15 user nova-compute[75205]:     </serial>
Nov 14 19:13:15 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:13:15 user nova-compute[75205]:     <video>
Nov 14 19:13:15 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:13:15 user nova-compute[75205]:     </video>
Nov 14 19:13:15 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:13:15 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:13:15 user nova-compute[75205]:     </rng>
Nov 14 19:13:15 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:13:15 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:13:15 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:13:15 user nova-compute[75205]:     </memballoon>
Nov 14 19:13:15 user nova-compute[75205]:   </devices>
Nov 14 19:13:15 user nova-compute[75205]: </domain>
Nov 14 19:13:15 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:13:15 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Instance destroyed successfully.
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No VIF found with MAC fa:16:3e:02:4e:6d, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:13:15 user nova-compute[75205]: INFO nova.compute.claims [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Claim successful on node user
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.network.neutron [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:13:16 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.policy [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '614f7aa49ee045c1a3cd9d23cb6bdebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ef713467204951b8d5433d80805441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:13:16 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Creating image(s)
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "/opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "/opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.205s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-6f4d0fd8-fdc2-47ba-b71e-63165fca0459 req-35ee86d1-9c92-43d8-b8ef-bf48c3e5b3d6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6f4d0fd8-fdc2-47ba-b71e-63165fca0459 req-35ee86d1-9c92-43d8-b8ef-bf48c3e5b3d6 service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6f4d0fd8-fdc2-47ba-b71e-63165fca0459 req-35ee86d1-9c92-43d8-b8ef-bf48c3e5b3d6 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6f4d0fd8-fdc2-47ba-b71e-63165fca0459 req-35ee86d1-9c92-43d8-b8ef-bf48c3e5b3d6 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-6f4d0fd8-fdc2-47ba-b71e-63165fca0459 req-35ee86d1-9c92-43d8-b8ef-bf48c3e5b3d6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:16 user nova-compute[75205]: WARNING nova.compute.manager [req-6f4d0fd8-fdc2-47ba-b71e-63165fca0459 req-35ee86d1-9c92-43d8-b8ef-bf48c3e5b3d6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state active and task_state rescuing.
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk 1073741824" returned: 0 in 0.060s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.226s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Cannot resize image /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Ensure instance console log exists: /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG nova.network.neutron [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Successfully created port: 814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:17 user nova-compute[75205]: INFO nova.compute.manager [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Detaching volume 7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:13:18 user nova-compute[75205]: INFO nova.virt.block_device [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Attempting to driver detach volume 7ff8caf6-fb6d-479b-a255-66d010cfa519 from mountpoint /dev/vdb
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Attempting to detach device vdb from instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:13:18 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:13:18 user nova-compute[75205]:   <source dev="/dev/sdg"/>
Nov 14 19:13:18 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:13:18 user nova-compute[75205]:   <serial>7ff8caf6-fb6d-479b-a255-66d010cfa519</serial>
Nov 14 19:13:18 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:13:18 user nova-compute[75205]: </disk>
Nov 14 19:13:18 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:13:18 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully detached device vdb from instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d from the persistent domain config.
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:13:18 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:13:18 user nova-compute[75205]:   <source dev="/dev/sdg"/>
Nov 14 19:13:18 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:13:18 user nova-compute[75205]:   <serial>7ff8caf6-fb6d-479b-a255-66d010cfa519</serial>
Nov 14 19:13:18 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:13:18 user nova-compute[75205]: </disk>
Nov 14 19:13:18 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Successfully updated port: 814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquired lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating instance_info_cache with network_info: [{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Releasing lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.compute.manager [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance network_info: |[{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Start _get_guest_xml network_info=[{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:13:18 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:13:18 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1772840421',display_name='tempest-ServerActionsTestOtherB-server-1772840421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1772840421',id=19,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUvKLnxFaWKfqQ4S/vwP+KIMyYqWAdaytSw3dniXzUF4xEGN7HlZuv7hGHWqxL9ir7W3jD5e9NmeSnZ82sU02gBYwBF2DuOPl6Jkk6gX2AGI1xcTXp5bR0/Q/rxf2ub4A==',key_name='tempest-keypair-444037287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41ef713467204951b8d5433d80805441',ramdisk_id='',reservation_id='r-5k36qfa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-938366899',owner_user_name='tempest-ServerActionsTestOtherB-938366899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614f7aa49ee045c1a3cd9d23cb6bdebe',uuid=c7744d82-c045-4602-9d7a-83f7d331a77e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converting VIF {"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.objects.instance [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lazy-loading 'pci_devices' on Instance uuid c7744d82-c045-4602-9d7a-83f7d331a77e {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:13:18 user nova-compute[75205]:   <uuid>c7744d82-c045-4602-9d7a-83f7d331a77e</uuid>
Nov 14 19:13:18 user nova-compute[75205]:   <name>instance-00000013</name>
Nov 14 19:13:18 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:13:18 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:13:18 user nova-compute[75205]:   <metadata>
Nov 14 19:13:18 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:13:18 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:13:18 user nova-compute[75205]:       <nova:name>tempest-ServerActionsTestOtherB-server-1772840421</nova:name>
Nov 14 19:13:18 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:13:18</nova:creationTime>
Nov 14 19:13:18 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:13:18 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:13:18 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:13:18 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:13:18 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:13:18 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:13:18 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:13:18 user nova-compute[75205]:       <nova:owner>
Nov 14 19:13:18 user nova-compute[75205]:         <nova:user uuid="614f7aa49ee045c1a3cd9d23cb6bdebe">tempest-ServerActionsTestOtherB-938366899-project-member</nova:user>
Nov 14 19:13:18 user nova-compute[75205]:         <nova:project uuid="41ef713467204951b8d5433d80805441">tempest-ServerActionsTestOtherB-938366899</nova:project>
Nov 14 19:13:18 user nova-compute[75205]:       </nova:owner>
Nov 14 19:13:18 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:13:18 user nova-compute[75205]:       <nova:ports>
Nov 14 19:13:18 user nova-compute[75205]:         <nova:port uuid="814f09b6-754e-4e78-947a-6a7c488019e0">
Nov 14 19:13:18 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 19:13:18 user nova-compute[75205]:         </nova:port>
Nov 14 19:13:18 user nova-compute[75205]:       </nova:ports>
Nov 14 19:13:18 user nova-compute[75205]:     </nova:instance>
Nov 14 19:13:18 user nova-compute[75205]:   </metadata>
Nov 14 19:13:18 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:13:18 user nova-compute[75205]:     <system>
Nov 14 19:13:18 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:13:18 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:13:18 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:13:18 user nova-compute[75205]:       <entry name="serial">c7744d82-c045-4602-9d7a-83f7d331a77e</entry>
Nov 14 19:13:18 user nova-compute[75205]:       <entry name="uuid">c7744d82-c045-4602-9d7a-83f7d331a77e</entry>
Nov 14 19:13:18 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:13:18 user nova-compute[75205]:     </system>
Nov 14 19:13:18 user nova-compute[75205]:   </sysinfo>
Nov 14 19:13:18 user nova-compute[75205]:   <os>
Nov 14 19:13:18 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:13:18 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:13:18 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:13:18 user nova-compute[75205]:   </os>
Nov 14 19:13:18 user nova-compute[75205]:   <features>
Nov 14 19:13:18 user nova-compute[75205]:     <acpi/>
Nov 14 19:13:18 user nova-compute[75205]:     <apic/>
Nov 14 19:13:18 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:13:18 user nova-compute[75205]:   </features>
Nov 14 19:13:18 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:13:18 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:13:18 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:13:18 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:13:18 user nova-compute[75205]:   </clock>
Nov 14 19:13:18 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:13:18 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:13:18 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:13:18 user nova-compute[75205]:   </cpu>
Nov 14 19:13:18 user nova-compute[75205]:   <devices>
Nov 14 19:13:18 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:13:18 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:13:18 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk"/>
Nov 14 19:13:18 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:13:18 user nova-compute[75205]:     </disk>
Nov 14 19:13:18 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:13:18 user nova-compute[75205]:       <mac address="fa:16:3e:c6:53:01"/>
Nov 14 19:13:18 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:13:18 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:13:18 user nova-compute[75205]:       <target dev="tap814f09b6-75"/>
Nov 14 19:13:18 user nova-compute[75205]:     </interface>
Nov 14 19:13:18 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:13:18 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/console.log" append="off"/>
Nov 14 19:13:18 user nova-compute[75205]:     </serial>
Nov 14 19:13:18 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:13:18 user nova-compute[75205]:     <video>
Nov 14 19:13:18 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:13:18 user nova-compute[75205]:     </video>
Nov 14 19:13:18 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:13:18 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:13:18 user nova-compute[75205]:     </rng>
Nov 14 19:13:18 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:13:18 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:13:18 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:13:18 user nova-compute[75205]:     </memballoon>
Nov 14 19:13:18 user nova-compute[75205]:   </devices>
Nov 14 19:13:18 user nova-compute[75205]: </domain>
Nov 14 19:13:18 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1772840421',display_name='tempest-ServerActionsTestOtherB-server-1772840421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1772840421',id=19,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUvKLnxFaWKfqQ4S/vwP+KIMyYqWAdaytSw3dniXzUF4xEGN7HlZuv7hGHWqxL9ir7W3jD5e9NmeSnZ82sU02gBYwBF2DuOPl6Jkk6gX2AGI1xcTXp5bR0/Q/rxf2ub4A==',key_name='tempest-keypair-444037287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41ef713467204951b8d5433d80805441',ramdisk_id='',reservation_id='r-5k36qfa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-938366899',owner_user_name='tempest-ServerActionsTestOtherB-938366899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614f7aa49ee045c1a3cd9d23cb6bdebe',uuid=c7744d82-c045-4602-9d7a-83f7d331a77e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converting VIF {"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG os_vif [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c79cea11-da97-55ad-a257-e596651392d7', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap814f09b6-75, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap814f09b6-75, col_values=(('qos', UUID('5cebade0-d661-47fc-9f67-2f9e10a277e7')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap814f09b6-75, col_values=(('external_ids', {'iface-id': '814f09b6-754e-4e78-947a-6a7c488019e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:53:01', 'vm-uuid': 'c7744d82-c045-4602-9d7a-83f7d331a77e'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:18 user nova-compute[75205]: INFO os_vif [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75')
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] No VIF found with MAC fa:16:3e:c6:53:01, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:13:18 user nova-compute[75205]: DEBUG nova.compute.manager [None req-37582425-d684-4e7d-915b-5a67d7b6c55f tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:19 user nova-compute[75205]: WARNING nova.compute.manager [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state active and task_state rescuing.
Nov 14 19:13:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-changed-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Refreshing instance network info cache due to event network-changed-814f09b6-754e-4e78-947a-6a7c488019e0. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] Acquiring lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] Acquired lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Refreshing network info cache for port 814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updated VIF entry in instance network info cache for port 814f09b6-754e-4e78-947a-6a7c488019e0. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating instance_info_cache with network_info: [{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5fca92b3-1f6d-44a3-b5e9-0c3e4b4db1c3 req-70e61eff-40c7-40c4-9e90-826fdfc2898a service nova] Releasing lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-443b4eab-9f36-4be9-8dd3-9c4b52a1c75c req-6b502c8a-9767-4f5c-b94b-1f5fec99eb38 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-443b4eab-9f36-4be9-8dd3-9c4b52a1c75c req-6b502c8a-9767-4f5c-b94b-1f5fec99eb38 service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-443b4eab-9f36-4be9-8dd3-9c4b52a1c75c req-6b502c8a-9767-4f5c-b94b-1f5fec99eb38 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-443b4eab-9f36-4be9-8dd3-9c4b52a1c75c req-6b502c8a-9767-4f5c-b94b-1f5fec99eb38 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-443b4eab-9f36-4be9-8dd3-9c4b52a1c75c req-6b502c8a-9767-4f5c-b94b-1f5fec99eb38 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:20 user nova-compute[75205]: WARNING nova.compute.manager [req-443b4eab-9f36-4be9-8dd3-9c4b52a1c75c req-6b502c8a-9767-4f5c-b94b-1f5fec99eb38 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state building and task_state spawning.
Nov 14 19:13:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:13:22 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance spawned successfully.
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-0ca4273e-e5b5-4849-aac4-01e680273e98 req-f71916ea-6de4-4291-a8e5-dc5c34ff1d39 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0ca4273e-e5b5-4849-aac4-01e680273e98 req-f71916ea-6de4-4291-a8e5-dc5c34ff1d39 service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0ca4273e-e5b5-4849-aac4-01e680273e98 req-f71916ea-6de4-4291-a8e5-dc5c34ff1d39 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0ca4273e-e5b5-4849-aac4-01e680273e98 req-f71916ea-6de4-4291-a8e5-dc5c34ff1d39 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-0ca4273e-e5b5-4849-aac4-01e680273e98 req-f71916ea-6de4-4291-a8e5-dc5c34ff1d39 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:22 user nova-compute[75205]: WARNING nova.compute.manager [req-0ca4273e-e5b5-4849-aac4-01e680273e98 req-f71916ea-6de4-4291-a8e5-dc5c34ff1d39 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state building and task_state spawning.
Nov 14 19:13:22 user nova-compute[75205]: INFO nova.compute.manager [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:13:22 user nova-compute[75205]: INFO nova.compute.manager [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Took 6.77 seconds to build instance.
Nov 14 19:13:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d262dc36-d663-4db5-a21b-1abf9353413f tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.886s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:13:22 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Updating instance_info_cache with network_info: [{"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-1f24f442-1547-4f20-ba7c-f7790dcc37af" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue --force-share --output=json" returned: 0 in 0.284s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:28 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:13:28 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7292MB free_disk=25.178211212158203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1f24f442-1547-4f20-ba7c-f7790dcc37af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 55940268-4985-49a7-8e4d-baa0051122cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 34cf679a-1aa5-453a-abca-9db47cf798ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance c7744d82-c045-4602-9d7a-83f7d331a77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:13:28 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:13:29 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:13:29 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:13:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:13:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:13:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:13:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:13:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:30 user nova-compute[75205]: INFO nova.compute.manager [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Unshelving
Nov 14 19:13:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:30 user nova-compute[75205]: INFO nova.virt.block_device [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Booting with volume bfabcc69-245e-4604-b0f7-19a66c796651 at /dev/vda
Nov 14 19:13:30 user nova-compute[75205]: DEBUG os_brick.utils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8135f8-4596-4f8b-8d3a-6239be1e3754]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40e8f87-2588-4b3a-bde5-8d6c4e884840]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbf899d-0802-497f-8ea4-822db7d531bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14f9deb-be7f-4d3b-80bc-2919b452a005]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:13:31 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:13:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba07f3e-095e-4e39-bd48-3fed481b4f32]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG os_brick.utils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating existing volume attachment record: 61396951-c346-47ff-bcb5-c24a319e2e15 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "55940268-4985-49a7-8e4d-baa0051122cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "55940268-4985-49a7-8e4d-baa0051122cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "55940268-4985-49a7-8e4d-baa0051122cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "55940268-4985-49a7-8e4d-baa0051122cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "55940268-4985-49a7-8e4d-baa0051122cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.005s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:31 user nova-compute[75205]: INFO nova.compute.manager [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Terminating instance
Nov 14 19:13:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-01187389-d357-4abc-8fdb-fa171ee6d660 req-1c049dac-900f-47e6-8fd4-041b986ebf56 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Received event network-vif-unplugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-01187389-d357-4abc-8fdb-fa171ee6d660 req-1c049dac-900f-47e6-8fd4-041b986ebf56 service nova] Acquiring lock "55940268-4985-49a7-8e4d-baa0051122cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-01187389-d357-4abc-8fdb-fa171ee6d660 req-1c049dac-900f-47e6-8fd4-041b986ebf56 service nova] Lock "55940268-4985-49a7-8e4d-baa0051122cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-01187389-d357-4abc-8fdb-fa171ee6d660 req-1c049dac-900f-47e6-8fd4-041b986ebf56 service nova] Lock "55940268-4985-49a7-8e4d-baa0051122cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-01187389-d357-4abc-8fdb-fa171ee6d660 req-1c049dac-900f-47e6-8fd4-041b986ebf56 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] No waiting events found dispatching network-vif-unplugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-01187389-d357-4abc-8fdb-fa171ee6d660 req-1c049dac-900f-47e6-8fd4-041b986ebf56 service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Received event network-vif-unplugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Instance destroyed successfully.
Nov 14 19:13:32 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lazy-loading 'resources' on Instance uuid 55940268-4985-49a7-8e4d-baa0051122cf {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1922657440',display_name='tempest-VolumesAdminNegativeTest-server-1922657440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1922657440',id=14,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:11:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ba7425d60794409b74ed4fe0e902536',ramdisk_id='',reservation_id='r-vwqs8zml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-368867561',owner_user_name='tempest-VolumesAdminNegativeTest-368867561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:11:44Z,user_data=None,user_id='53dc67514dda4ef7b51122f81c6feb02',uuid=55940268-4985-49a7-8e4d-baa0051122cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "address": "fa:16:3e:eb:89:51", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e335ab6-ea", "ovs_interfaceid": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converting VIF {"id": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "address": "fa:16:3e:eb:89:51", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e335ab6-ea", "ovs_interfaceid": "4e335ab6-ea34-4dcd-bcba-305388ca6f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:51,bridge_name='br-int',has_traffic_filtering=True,id=4e335ab6-ea34-4dcd-bcba-305388ca6f81,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e335ab6-ea') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG os_vif [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:51,bridge_name='br-int',has_traffic_filtering=True,id=4e335ab6-ea34-4dcd-bcba-305388ca6f81,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e335ab6-ea') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e335ab6-ea, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5e86ce7-56f1-414b-bbc1-1177d41224f5) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:32 user nova-compute[75205]: INFO os_vif [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:51,bridge_name='br-int',has_traffic_filtering=True,id=4e335ab6-ea34-4dcd-bcba-305388ca6f81,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e335ab6-ea')
Nov 14 19:13:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Deleting instance files /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf_del
Nov 14 19:13:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Deletion of /opt/stack/data/nova/instances/55940268-4985-49a7-8e4d-baa0051122cf_del complete
Nov 14 19:13:32 user nova-compute[75205]: INFO nova.compute.manager [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 19:13:32 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:13:32 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:13:33 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:33 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Took 0.71 seconds to deallocate network for instance.
Nov 14 19:13:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-77f99767-4148-4b7a-9cba-70f06aa64d06 req-08ed3b5f-42c2-4b9e-b719-44ef0702815f service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Received event network-vif-deleted-4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:33 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:13:33 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:13:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:33 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Deleted allocations for instance 55940268-4985-49a7-8e4d-baa0051122cf
Nov 14 19:13:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ed5acb8-8814-4b98-ab31-8cfda6e107fe tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "55940268-4985-49a7-8e4d-baa0051122cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.286s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-ca47c283-a395-45d8-b2b4-38ae68807402 req-83cf997d-edb4-47a3-903d-bad1a83978ee service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Received event network-vif-plugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ca47c283-a395-45d8-b2b4-38ae68807402 req-83cf997d-edb4-47a3-903d-bad1a83978ee service nova] Acquiring lock "55940268-4985-49a7-8e4d-baa0051122cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ca47c283-a395-45d8-b2b4-38ae68807402 req-83cf997d-edb4-47a3-903d-bad1a83978ee service nova] Lock "55940268-4985-49a7-8e4d-baa0051122cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ca47c283-a395-45d8-b2b4-38ae68807402 req-83cf997d-edb4-47a3-903d-bad1a83978ee service nova] Lock "55940268-4985-49a7-8e4d-baa0051122cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-ca47c283-a395-45d8-b2b4-38ae68807402 req-83cf997d-edb4-47a3-903d-bad1a83978ee service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] No waiting events found dispatching network-vif-plugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:34 user nova-compute[75205]: WARNING nova.compute.manager [req-ca47c283-a395-45d8-b2b4-38ae68807402 req-83cf997d-edb4-47a3-903d-bad1a83978ee service nova] [instance: 55940268-4985-49a7-8e4d-baa0051122cf] Received unexpected event network-vif-plugged-4e335ab6-ea34-4dcd-bcba-305388ca6f81 for instance with vm_state deleted and task_state None.
Nov 14 19:13:36 user nova-compute[75205]: DEBUG nova.compute.manager [req-17f112f3-0d3c-45be-adab-11325ea3fda5 req-1c2212a1-460b-49ad-ba84-d50c08459a5e service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-changed-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG nova.compute.manager [req-17f112f3-0d3c-45be-adab-11325ea3fda5 req-1c2212a1-460b-49ad-ba84-d50c08459a5e service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing instance network info cache due to event network-changed-fd4dab88-47b5-4558-a23d-dfa94e2ad64c. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-17f112f3-0d3c-45be-adab-11325ea3fda5 req-1c2212a1-460b-49ad-ba84-d50c08459a5e service nova] Acquiring lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-17f112f3-0d3c-45be-adab-11325ea3fda5 req-1c2212a1-460b-49ad-ba84-d50c08459a5e service nova] Acquired lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG nova.network.neutron [req-17f112f3-0d3c-45be-adab-11325ea3fda5 req-1c2212a1-460b-49ad-ba84-d50c08459a5e service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Refreshing network info cache for port fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG nova.objects.instance [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lazy-loading 'pci_requests' on Instance uuid a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG nova.objects.instance [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lazy-loading 'numa_topology' on Instance uuid a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:13:36 user nova-compute[75205]: INFO nova.compute.claims [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Claim successful on node user
Nov 14 19:13:36 user nova-compute[75205]: DEBUG nova.network.neutron [req-17f112f3-0d3c-45be-adab-11325ea3fda5 req-1c2212a1-460b-49ad-ba84-d50c08459a5e service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updated VIF entry in instance network info cache for port fd4dab88-47b5-4558-a23d-dfa94e2ad64c. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG nova.network.neutron [req-17f112f3-0d3c-45be-adab-11325ea3fda5 req-1c2212a1-460b-49ad-ba84-d50c08459a5e service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [{"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-17f112f3-0d3c-45be-adab-11325ea3fda5 req-1c2212a1-460b-49ad-ba84-d50c08459a5e service nova] Releasing lock "refresh_cache-34cf679a-1aa5-453a-abca-9db47cf798ef" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:13:36 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:13:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:37 user nova-compute[75205]: INFO nova.network.neutron [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating port d78d73b9-cc60-4324-b5e4-2dede8700c73 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 19:13:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:13:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquired lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:13:37 user nova-compute[75205]: DEBUG nova.network.neutron [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:13:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-29408bb2-bf0c-4d14-895a-cf5b52f5c84f req-31942902-f450-4a3b-86ed-d6d207319b6b service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-changed-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-29408bb2-bf0c-4d14-895a-cf5b52f5c84f req-31942902-f450-4a3b-86ed-d6d207319b6b service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Refreshing instance network info cache due to event network-changed-d78d73b9-cc60-4324-b5e4-2dede8700c73. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:13:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-29408bb2-bf0c-4d14-895a-cf5b52f5c84f req-31942902-f450-4a3b-86ed-d6d207319b6b service nova] Acquiring lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.network.neutron [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating instance_info_cache with network_info: [{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Releasing lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:13:38 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Creating image(s)
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Ensure instance console log exists: /opt/stack/data/nova/instances/a3f91cd5-9ad2-49a0-9b53-4df71c63ff29/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Start _get_guest_xml network_info=[{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbIWepfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3f91cd5-9ad2-49a0-9b53-4df71c63ff29', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfabcc69-245e-4604-b0f7-19a66c796651', 'serial': 'bfabcc69-245e-4604-b0f7-19a66c796651'}, 'attachment_id': '61396951-c346-47ff-bcb5-c24a319e2e15', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-29408bb2-bf0c-4d14-895a-cf5b52f5c84f req-31942902-f450-4a3b-86ed-d6d207319b6b service nova] Acquired lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.network.neutron [req-29408bb2-bf0c-4d14-895a-cf5b52f5c84f req-31942902-f450-4a3b-86ed-d6d207319b6b service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Refreshing network info cache for port d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:13:38 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:13:38 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.objects.instance [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.objects.base [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Object Instance<a3f91cd5-9ad2-49a0-9b53-4df71c63ff29> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbIWepfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:13:38 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:13:38 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:13:38 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4ea825-a029-4922-8e89-571f7f2b99e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:13:38 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5260a14a-f9d9-4995-8148-941be6dba62a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651] added
Nov 14 19:13:38 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f231a18-d886-47e3-9ded-2a6d78f765b9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:38 user nova-compute[75205]: INFO nova.compute.manager [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Terminating instance
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1fba99-c9cc-4513-9d9e-9a5aabd5575d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbIWepfx {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbIWepfx" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccf662d-3fe6-4d2f-8f58-f21446fa5906]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbIWepfx'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efc5ed6-82ac-43aa-a8ef-01db60ac0db2]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3211efb5-efaf-49ec-a236-0d161ad70310]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dc4ac1-9139-41c2-9980-285f60c493e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260]
Nov 14 19:13:38 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260] successful.
Nov 14 19:13:38 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f6f46d-731d-4de2-9f91-681b18198c5b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d73ac3-0c87-4664-b02f-51bf947dc3d3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:13:38 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0ca787-c571-4854-b7f5-3dfea2280fca]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbIWepfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.compute.manager [req-c94e0ef7-a40c-47de-814f-fed19673c07c req-2daf217e-9622-4af9-8a0c-51f99723803f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c94e0ef7-a40c-47de-814f-fed19673c07c req-2daf217e-9622-4af9-8a0c-51f99723803f service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c94e0ef7-a40c-47de-814f-fed19673c07c req-2daf217e-9622-4af9-8a0c-51f99723803f service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c94e0ef7-a40c-47de-814f-fed19673c07c req-2daf217e-9622-4af9-8a0c-51f99723803f service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.compute.manager [req-c94e0ef7-a40c-47de-814f-fed19673c07c req-2daf217e-9622-4af9-8a0c-51f99723803f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-unplugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.compute.manager [req-c94e0ef7-a40c-47de-814f-fed19673c07c req-2daf217e-9622-4af9-8a0c-51f99723803f service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.network.neutron [req-29408bb2-bf0c-4d14-895a-cf5b52f5c84f req-31942902-f450-4a3b-86ed-d6d207319b6b service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updated VIF entry in instance network info cache for port d78d73b9-cc60-4324-b5e4-2dede8700c73. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.network.neutron [req-29408bb2-bf0c-4d14-895a-cf5b52f5c84f req-31942902-f450-4a3b-86ed-d6d207319b6b service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating instance_info_cache with network_info: [{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-29408bb2-bf0c-4d14-895a-cf5b52f5c84f req-31942902-f450-4a3b-86ed-d6d207319b6b service nova] Releasing lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d is timed out.
Nov 14 19:13:38 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully detached device vdb from instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d from the live domain config.
Nov 14 19:13:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frjDzlUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:13:38 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:13:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-746a3583-ff0f-43f4-b765-95127b33f128 req-b612db45-0c91-49b4-ae71-ba07cf8f219d service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-746a3583-ff0f-43f4-b765-95127b33f128 req-b612db45-0c91-49b4-ae71-ba07cf8f219d service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-746a3583-ff0f-43f4-b765-95127b33f128 req-b612db45-0c91-49b4-ae71-ba07cf8f219d service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-746a3583-ff0f-43f4-b765-95127b33f128 req-b612db45-0c91-49b4-ae71-ba07cf8f219d service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-746a3583-ff0f-43f4-b765-95127b33f128 req-b612db45-0c91-49b4-ae71-ba07cf8f219d service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-unplugged-60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-746a3583-ff0f-43f4-b765-95127b33f128 req-b612db45-0c91-49b4-ae71-ba07cf8f219d service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-60da9c54-607a-4873-94fd-e2d42286a938 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26634663734653131', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634663734653131', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.784s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e74c68e-c195-4ce9-9b6a-f8d9213848fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:13:39 user nova-compute[75205]: No targets found.
Nov 14 19:13:39 user nova-compute[75205]: iSNS:
Nov 14 19:13:39 user nova-compute[75205]: No targets found.
Nov 14 19:13:39 user nova-compute[75205]: STATIC:
Nov 14 19:13:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759
Nov 14 19:13:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1
Nov 14 19:13:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4
Nov 14 19:13:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:13:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:13:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e
Nov 14 19:13:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519
Nov 14 19:13:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:39 user nova-compute[75205]: FIRMWARE:
Nov 14 19:13:39 user nova-compute[75205]: No targets found.
Nov 14 19:13:39 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:13:39 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:13:39 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-12776011',display_name='tempest-TestShelveInstance-server-12776011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-12776011',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1819955855',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d2b1f81e3e4a4ae3a9b7554997d170c1',ramdisk_id='',reservation_id='r-rm2y2t00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1961803319',owner_user_name='tempest-TestShelveInstance-1961803319-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:13:31Z,user_data=None,user_id='07cd34c968a9444a95fd601767385cfe',uuid=a3f91cd5-9ad2-49a0-9b53-4df71c63ff29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converting VIF {"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.objects.instance [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lazy-loading 'pci_devices' on Instance uuid a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.objects.base [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Object Instance<a3f91cd5-9ad2-49a0-9b53-4df71c63ff29> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:13:39 user nova-compute[75205]:   <uuid>a3f91cd5-9ad2-49a0-9b53-4df71c63ff29</uuid>
Nov 14 19:13:39 user nova-compute[75205]:   <name>instance-0000000a</name>
Nov 14 19:13:39 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:13:39 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:13:39 user nova-compute[75205]:   <metadata>
Nov 14 19:13:39 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:13:39 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:13:39 user nova-compute[75205]:       <nova:name>tempest-TestShelveInstance-server-12776011</nova:name>
Nov 14 19:13:39 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:13:38</nova:creationTime>
Nov 14 19:13:39 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:13:39 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:13:39 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:13:39 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:13:39 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:13:39 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:13:39 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:13:39 user nova-compute[75205]:       <nova:owner>
Nov 14 19:13:39 user nova-compute[75205]:         <nova:user uuid="07cd34c968a9444a95fd601767385cfe">tempest-TestShelveInstance-1961803319-project-member</nova:user>
Nov 14 19:13:39 user nova-compute[75205]:         <nova:project uuid="d2b1f81e3e4a4ae3a9b7554997d170c1">tempest-TestShelveInstance-1961803319</nova:project>
Nov 14 19:13:39 user nova-compute[75205]:       </nova:owner>
Nov 14 19:13:39 user nova-compute[75205]:       <nova:ports>
Nov 14 19:13:39 user nova-compute[75205]:         <nova:port uuid="d78d73b9-cc60-4324-b5e4-2dede8700c73">
Nov 14 19:13:39 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:13:39 user nova-compute[75205]:         </nova:port>
Nov 14 19:13:39 user nova-compute[75205]:       </nova:ports>
Nov 14 19:13:39 user nova-compute[75205]:     </nova:instance>
Nov 14 19:13:39 user nova-compute[75205]:   </metadata>
Nov 14 19:13:39 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:13:39 user nova-compute[75205]:     <system>
Nov 14 19:13:39 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:13:39 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:13:39 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:13:39 user nova-compute[75205]:       <entry name="serial">a3f91cd5-9ad2-49a0-9b53-4df71c63ff29</entry>
Nov 14 19:13:39 user nova-compute[75205]:       <entry name="uuid">a3f91cd5-9ad2-49a0-9b53-4df71c63ff29</entry>
Nov 14 19:13:39 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:13:39 user nova-compute[75205]:     </system>
Nov 14 19:13:39 user nova-compute[75205]:   </sysinfo>
Nov 14 19:13:39 user nova-compute[75205]:   <os>
Nov 14 19:13:39 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:13:39 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:13:39 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:13:39 user nova-compute[75205]:   </os>
Nov 14 19:13:39 user nova-compute[75205]:   <features>
Nov 14 19:13:39 user nova-compute[75205]:     <acpi/>
Nov 14 19:13:39 user nova-compute[75205]:     <apic/>
Nov 14 19:13:39 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:13:39 user nova-compute[75205]:   </features>
Nov 14 19:13:39 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:13:39 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:13:39 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:13:39 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:13:39 user nova-compute[75205]:   </clock>
Nov 14 19:13:39 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:13:39 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:13:39 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:13:39 user nova-compute[75205]:   </cpu>
Nov 14 19:13:39 user nova-compute[75205]:   <devices>
Nov 14 19:13:39 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:13:39 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:13:39 user nova-compute[75205]:       <source dev="/dev/sdc"/>
Nov 14 19:13:39 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:13:39 user nova-compute[75205]:       <serial>bfabcc69-245e-4604-b0f7-19a66c796651</serial>
Nov 14 19:13:39 user nova-compute[75205]:     </disk>
Nov 14 19:13:39 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:13:39 user nova-compute[75205]:       <mac address="fa:16:3e:9c:b5:45"/>
Nov 14 19:13:39 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:13:39 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:13:39 user nova-compute[75205]:       <target dev="tapd78d73b9-cc"/>
Nov 14 19:13:39 user nova-compute[75205]:     </interface>
Nov 14 19:13:39 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:13:39 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/a3f91cd5-9ad2-49a0-9b53-4df71c63ff29/console.log" append="off"/>
Nov 14 19:13:39 user nova-compute[75205]:     </serial>
Nov 14 19:13:39 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:13:39 user nova-compute[75205]:     <video>
Nov 14 19:13:39 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:13:39 user nova-compute[75205]:     </video>
Nov 14 19:13:39 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:13:39 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:13:39 user nova-compute[75205]:     </rng>
Nov 14 19:13:39 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:13:39 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:13:39 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:13:39 user nova-compute[75205]:     </memballoon>
Nov 14 19:13:39 user nova-compute[75205]:   </devices>
Nov 14 19:13:39 user nova-compute[75205]: </domain>
Nov 14 19:13:39 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-12776011',display_name='tempest-TestShelveInstance-server-12776011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-12776011',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1819955855',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:09:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d2b1f81e3e4a4ae3a9b7554997d170c1',ramdisk_id='',reservation_id='r-rm2y2t00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1961803319',owner_user_name='tempest-TestShelveInstance-1961803319-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:13:31Z,user_data=None,user_id='07cd34c968a9444a95fd601767385cfe',uuid=a3f91cd5-9ad2-49a0-9b53-4df71c63ff29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converting VIF {"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_vif [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef527db7-9463-4452-8193-d95800583611]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '881fdb6b-870c-587f-bfac-97041ea7bf7f', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c517fa9-e599-41aa-bb86-97909b53101f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 (non-flash)
Nov 14 19:13:39 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c261510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519'): ({'sdg'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Removing single pathed devices sdg {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1610a4a8-89f2-46e1-9832-9c8bbe294067]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fccb5ed-f590-4ad7-9f21-422f8660069e]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flushing IO for device /dev/sdg {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0709f8a8-6153-49bc-ab00-eba253b86af1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd78d73b9-cc, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd78d73b9-cc, col_values=(('qos', UUID('5f05cd6b-08de-4f14-b2b0-f9906a95fd17')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd78d73b9-cc, col_values=(('external_ids', {'iface-id': 'd78d73b9-cc60-4324-b5e4-2dede8700c73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:b5:45', 'vm-uuid': 'a3f91cd5-9ad2-49a0-9b53-4df71c63ff29'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afda32e-6ed8-4537-8294-20faa7907d0d]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] SCSI volumes sdg have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc722dbaf-115d60e017a91512', '/dev/disk/by-id/scsi-23131356436306530', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c722dbaf') {{(pid=85714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f1ec0c-57fc-4f69-92c4-bd0fb3f9092c]: (4, None) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-unplugged-3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-3a669c43-3923-4432-ab6a-466136662357 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-3a669c43-3923-4432-ab6a-466136662357 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:39 user nova-compute[75205]: WARNING nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-3a669c43-3923-4432-ab6a-466136662357 for instance with vm_state active and task_state deleting.
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-unplugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:39 user nova-compute[75205]: WARNING nova.compute.manager [req-c8cecb98-09cd-4019-b4a7-babb9b8e157b req-45484cc9-495b-4832-bb8f-e15161446461 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-ee97e4ba-8b52-478f-95fa-378821a4fd4c for instance with vm_state active and task_state deleting.
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[950a9581-d621-4fda-bc19-d85d087c56b3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:39 user nova-compute[75205]: INFO os_vif [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc')
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec95108-dfff-453d-b94e-77140beb0eaf]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519, portal: 172.16.0.220,3260]
Nov 14 19:13:39 user nova-compute[75205]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519, portal: 172.16.0.220,3260] successful.
Nov 14 19:13:39 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff8caf6-fb6d-479b-a255-66d010cfa519 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4933774b-43bb-4e88-b891-cdba242b5d54]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] <== disconnect_volume: return (1247ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:13:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] No VIF found with MAC fa:16:3e:9c:b5:45, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:13:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Instance destroyed successfully.
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.objects.instance [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lazy-loading 'resources' on Instance uuid 34cf679a-1aa5-453a-abca-9db47cf798ef {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "address": "fa:16:3e:d5:6c:98", "network": {"id": "1be41a27-3a73-4057-9917-def756e20cc5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117884955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4dab88-47", "ovs_interfaceid": "fd4dab88-47b5-4558-a23d-dfa94e2ad64c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:6c:98,bridge_name='br-int',has_traffic_filtering=True,id=fd4dab88-47b5-4558-a23d-dfa94e2ad64c,network=Network(1be41a27-3a73-4057-9917-def756e20cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4dab88-47') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:6c:98,bridge_name='br-int',has_traffic_filtering=True,id=fd4dab88-47b5-4558-a23d-dfa94e2ad64c,network=Network(1be41a27-3a73-4057-9917-def756e20cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4dab88-47') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd4dab88-47, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70272564-9e8c-458c-9080-5a964954a32e) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: INFO os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:6c:98,bridge_name='br-int',has_traffic_filtering=True,id=fd4dab88-47b5-4558-a23d-dfa94e2ad64c,network=Network(1be41a27-3a73-4057-9917-def756e20cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4dab88-47')
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=3a669c43-3923-4432-ab6a-466136662357,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a669c43-39') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=3a669c43-3923-4432-ab6a-466136662357,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a669c43-39') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a669c43-39, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a11c78d-ef18-4e6a-bd81-326da74dce32) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:40 user nova-compute[75205]: WARNING nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-fd4dab88-47b5-4558-a23d-dfa94e2ad64c for instance with vm_state active and task_state deleting.
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-unplugged-abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-abe87def-a869-4cb5-8d72-3f231507f40e for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-abe87def-a869-4cb5-8d72-3f231507f40e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:40 user nova-compute[75205]: WARNING nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-abe87def-a869-4cb5-8d72-3f231507f40e for instance with vm_state active and task_state deleting.
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-unplugged-04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-04afe31a-5ddd-475b-a353-9465641b535f for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:40 user nova-compute[75205]: WARNING nova.compute.manager [req-2a7d237f-e664-4064-b607-90dc38b878a0 req-61c19cfa-c6df-4ba8-8dc8-264e39a92dda service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-04afe31a-5ddd-475b-a353-9465641b535f for instance with vm_state active and task_state deleting.
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: INFO os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=3a669c43-3923-4432-ab6a-466136662357,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a669c43-39')
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c8:23,bridge_name='br-int',has_traffic_filtering=True,id=abe87def-a869-4cb5-8d72-3f231507f40e,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabe87def-a8') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c8:23,bridge_name='br-int',has_traffic_filtering=True,id=abe87def-a869-4cb5-8d72-3f231507f40e,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabe87def-a8') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabe87def-a8, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b0bc1ae-c14d-4abc-af02-a3ced0eadac1) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: INFO os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c8:23,bridge_name='br-int',has_traffic_filtering=True,id=abe87def-a869-4cb5-8d72-3f231507f40e,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabe87def-a8')
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:f8,bridge_name='br-int',has_traffic_filtering=True,id=60da9c54-607a-4873-94fd-e2d42286a938,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da9c54-60') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:f8,bridge_name='br-int',has_traffic_filtering=True,id=60da9c54-607a-4873-94fd-e2d42286a938,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da9c54-60') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60da9c54-60, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b49177ef-6d36-436d-b85b-be921824d84c) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: INFO os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:f8,bridge_name='br-int',has_traffic_filtering=True,id=60da9c54-607a-4873-94fd-e2d42286a938,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da9c54-60')
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:e5,bridge_name='br-int',has_traffic_filtering=True,id=368d010b-d5d4-4c97-9fba-58a6a3ae869d,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368d010b-d5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:e5,bridge_name='br-int',has_traffic_filtering=True,id=368d010b-d5d4-4c97-9fba-58a6a3ae869d,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368d010b-d5') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap368d010b-d5, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebcd79d7-cdcd-45af-bf60-20a332d66715) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'flavor' on Instance uuid 2d89bc07-90a1-49ef-8d67-e7263bd06e6d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: INFO os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:20:e5,bridge_name='br-int',has_traffic_filtering=True,id=368d010b-d5d4-4c97-9fba-58a6a3ae869d,network=Network(836cea9c-9d63-4a48-a04a-7d33f6a4e4bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368d010b-d5')
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:db:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee97e4ba-8b52-478f-95fa-378821a4fd4c,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97e4ba-8b') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:db:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee97e4ba-8b52-478f-95fa-378821a4fd4c,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97e4ba-8b') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee97e4ba-8b, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=879d8078-2401-4264-adcb-90f5afd6859e) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0d5c7d92-c436-4328-998f-e6e4541f2f87 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.013s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: INFO os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:db:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee97e4ba-8b52-478f-95fa-378821a4fd4c,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97e4ba-8b')
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2130674706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2130674706',id=15,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMImMtd4oEGCdfGUyDk5aBHIUT6ipjkg3c+aj/f98ziWXI7mW5Tt6ZOieMI95y28cULFeQ2lO8irmSs6iI+nhvHRS64p8kN5rZQ4fRsOAOYNokhGlncHq0esG8yAcVRYcA==',key_name='tempest-keypair-1321131215',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b852c4de81a8466882905f1c6801f0cf',ramdisk_id='',reservation_id='r-q11p2k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-323420199',owner_user_name='tempest-TaggedBootDevicesTest-323420199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a5796455b0d47b5afd1738e2fb099af',uuid=34cf679a-1aa5-453a-abca-9db47cf798ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converting VIF {"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=04afe31a-5ddd-475b-a353-9465641b535f,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04afe31a-5d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=04afe31a-5ddd-475b-a353-9465641b535f,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04afe31a-5d') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04afe31a-5d, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa886fae-be28-46c9-bcfa-92212033ea4a) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: INFO os_vif [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=04afe31a-5ddd-475b-a353-9465641b535f,network=Network(1803b4a1-b7a1-4322-b4f5-338b9934f771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04afe31a-5d')
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BWCuazJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:13:41 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5273273b-ad36-4d10-8460-a18e59a0f0d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:13:41 user nova-compute[75205]: No targets found.
Nov 14 19:13:41 user nova-compute[75205]: iSNS:
Nov 14 19:13:41 user nova-compute[75205]: No targets found.
Nov 14 19:13:41 user nova-compute[75205]: STATIC:
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: FIRMWARE:
Nov 14 19:13:41 user nova-compute[75205]: No targets found.
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:13:41 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:13:41 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b9bcd-8b46-4a89-94fa-9d22ae8cfa70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:41 user nova-compute[75205]: WARNING nova.compute.manager [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-60da9c54-607a-4873-94fd-e2d42286a938 for instance with vm_state active and task_state deleting.
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-unplugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-unplugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-plugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] Acquiring lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] No waiting events found dispatching network-vif-plugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:41 user nova-compute[75205]: WARNING nova.compute.manager [req-f8125073-2359-4325-a9cb-9e0e33a6e99a req-d13b911f-a017-45f5-abb1-f7050576a416 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received unexpected event network-vif-plugged-368d010b-d5d4-4c97-9fba-58a6a3ae869d for instance with vm_state active and task_state deleting.
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c300d74f-a5d1-4984-87d3-47d384555c4a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7412d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1'): ({'sde'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Removing single pathed devices sde {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[139b6863-2d82-4ddd-a27b-b56becec62b8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d11bbb-c742-49a4-9d71-198bc8db1ca8]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Flushing IO for device /dev/sde {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.011s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[921b8342-f1aa-42a4-8b13-3f4a7fedfa6e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[766cdf66-9d8e-4246-9a48-f2b7955a065d]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85d2c19-d46c-450b-be1a-058d82c69a96]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de31f89-2786-451c-a80d-88de43eacbe2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1, portal: 172.16.0.220,3260]
Nov 14 19:13:41 user nova-compute[75205]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1, portal: 172.16.0.220,3260] successful.
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002a42fd-27a3-45f1-af37-42ab1b8321e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e50fd22-ca78-4218-ada1-d793251268e0]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] <== disconnect_volume: return (365ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psCLaZGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:13:41 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a355a1ba-e70e-4ff4-ab50-52c8e094ab5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:13:41 user nova-compute[75205]: No targets found.
Nov 14 19:13:41 user nova-compute[75205]: iSNS:
Nov 14 19:13:41 user nova-compute[75205]: No targets found.
Nov 14 19:13:41 user nova-compute[75205]: STATIC:
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: FIRMWARE:
Nov 14 19:13:41 user nova-compute[75205]: No targets found.
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:13:41 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:13:41 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[22830c66-2486-4b8e-9308-47ff09766332]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1448264-f968-4557-a8c3-255cee9ee6f4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb741f2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e'): ({'sdf'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Removing single pathed devices sdf {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[70553cef-a2c2-4ed5-96eb-501a2c570d39]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8212efc0-1ee6-4bdd-97d7-0f6b330f54fd]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Flushing IO for device /dev/sdf {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[45640d69-0392-4854-ba4e-549ba107873d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb52dac-e4e2-4091-a151-8d23d6a88f5c]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] SCSI volumes sdf have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b16d734-23fd-45a2-9e4d-3bfddce06791]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37fe278-0826-4523-bed6-3638d9e9fd12]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e, portal: 172.16.0.220,3260]
Nov 14 19:13:41 user nova-compute[75205]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e, portal: 172.16.0.220,3260] successful.
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f0cda0-d13e-4f97-be7d-c3e12a58731e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[267decd5-474f-42f3-8134-7182f8afd4ed]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] <== disconnect_volume: return (342ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVAhGfxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:13:41 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf6c93-9a93-40d8-a69d-f02625accb2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:13:41 user nova-compute[75205]: No targets found.
Nov 14 19:13:41 user nova-compute[75205]: iSNS:
Nov 14 19:13:41 user nova-compute[75205]: No targets found.
Nov 14 19:13:41 user nova-compute[75205]: STATIC:
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:13:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:13:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:13:41 user nova-compute[75205]: FIRMWARE:
Nov 14 19:13:41 user nova-compute[75205]: No targets found.
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:13:41 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:13:41 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[526d24e6-c1ae-44e7-8257-3dbe6a8ff355]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1cecc7-3060-4cca-ba45-056ddd877922]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:13:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb741f2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759'): ({'sdh'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Removing single pathed devices sdh {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[484ca43e-621f-4bf0-aa6b-7f4d61f15a5a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4eb5bc-0810-47db-8de1-1a3822e01ecc]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Flushing IO for device /dev/sdh {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fb681c-1170-4872-9301-45ebec29c987]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.031s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e624a15-e597-4ce2-9940-306f0e4a7b84]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] SCSI volumes sdh have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2956ca-36d5-455c-b580-836a5a748e50]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9bfc88-f96b-4149-ad9c-5eb73bd35c65]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759, portal: 172.16.0.220,3260]
Nov 14 19:13:42 user nova-compute[75205]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759, portal: 172.16.0.220,3260] successful.
Nov 14 19:13:42 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c186fef0-f43c-4707-bc10-4863dc815759 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ffb01-283d-45c1-9f5a-eeb66207df0b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] <== disconnect_volume: return (305ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:13:42 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Deleting instance files /opt/stack/data/nova/instances/34cf679a-1aa5-453a-abca-9db47cf798ef_del
Nov 14 19:13:42 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Deletion of /opt/stack/data/nova/instances/34cf679a-1aa5-453a-abca-9db47cf798ef_del complete
Nov 14 19:13:42 user nova-compute[75205]: INFO nova.compute.manager [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Took 3.95 seconds to destroy the instance on the hypervisor.
Nov 14 19:13:42 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:13:42 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] No waiting events found dispatching network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:43 user nova-compute[75205]: WARNING nova.compute.manager [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received unexpected event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 19:13:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] No waiting events found dispatching network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:13:43 user nova-compute[75205]: WARNING nova.compute.manager [req-1e5aed65-eb7a-4274-8a8c-1e1fc8f46c50 req-35e42668-72c9-46a2-a3a5-ce7b59e5fe43 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received unexpected event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 19:13:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG nova.compute.manager [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:13:43 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Instance spawned successfully.
Nov 14 19:13:43 user nova-compute[75205]: DEBUG nova.compute.manager [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:13:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0b7989-4f95-463a-bfa4-fb61ca3bb461 tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.874s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-51d67c9a-f510-4718-9332-60defd6e10a7 req-5ee872d0-1936-42f4-8e53-4c202ffef9bd service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-deleted-fd4dab88-47b5-4558-a23d-dfa94e2ad64c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:44 user nova-compute[75205]: INFO nova.compute.manager [req-51d67c9a-f510-4718-9332-60defd6e10a7 req-5ee872d0-1936-42f4-8e53-4c202ffef9bd service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Neutron deleted interface fd4dab88-47b5-4558-a23d-dfa94e2ad64c; detaching it from the instance and deleting it from the info cache
Nov 14 19:13:44 user nova-compute[75205]: DEBUG nova.network.neutron [req-51d67c9a-f510-4718-9332-60defd6e10a7 req-5ee872d0-1936-42f4-8e53-4c202ffef9bd service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [{"id": "3a669c43-3923-4432-ab6a-466136662357", "address": "fa:16:3e:ca:77:5c", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a669c43-39", "ovs_interfaceid": "3a669c43-3923-4432-ab6a-466136662357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abe87def-a869-4cb5-8d72-3f231507f40e", "address": "fa:16:3e:e4:c8:23", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe87def-a8", "ovs_interfaceid": "abe87def-a869-4cb5-8d72-3f231507f40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60da9c54-607a-4873-94fd-e2d42286a938", "address": "fa:16:3e:a8:9a:f8", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da9c54-60", "ovs_interfaceid": "60da9c54-607a-4873-94fd-e2d42286a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "address": "fa:16:3e:15:20:e5", "network": {"id": "836cea9c-9d63-4a48-a04a-7d33f6a4e4bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-2096620740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368d010b-d5", "ovs_interfaceid": "368d010b-d5d4-4c97-9fba-58a6a3ae869d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "address": "fa:16:3e:7f:db:0a", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97e4ba-8b", "ovs_interfaceid": "ee97e4ba-8b52-478f-95fa-378821a4fd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04afe31a-5ddd-475b-a353-9465641b535f", "address": "fa:16:3e:78:2a:c6", "network": {"id": "1803b4a1-b7a1-4322-b4f5-338b9934f771", "bridge": "br-int", "label": "tempest-device-tagging-net2-1880367931", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b852c4de81a8466882905f1c6801f0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04afe31a-5d", "ovs_interfaceid": "04afe31a-5ddd-475b-a353-9465641b535f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-51d67c9a-f510-4718-9332-60defd6e10a7 req-5ee872d0-1936-42f4-8e53-4c202ffef9bd service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Detach interface failed, port_id=fd4dab88-47b5-4558-a23d-dfa94e2ad64c, reason: Instance 34cf679a-1aa5-453a-abca-9db47cf798ef could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:13:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:46 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:13:46 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Took 4.14 seconds to deallocate network for instance.
Nov 14 19:13:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-bbe7dbb7-8886-4cd3-b6ca-f480eb7301d4 req-10848836-9ef0-4c6f-8565-db88c39df305 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-deleted-ee97e4ba-8b52-478f-95fa-378821a4fd4c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-bbe7dbb7-8886-4cd3-b6ca-f480eb7301d4 req-10848836-9ef0-4c6f-8565-db88c39df305 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-deleted-368d010b-d5d4-4c97-9fba-58a6a3ae869d {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-bbe7dbb7-8886-4cd3-b6ca-f480eb7301d4 req-10848836-9ef0-4c6f-8565-db88c39df305 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-deleted-60da9c54-607a-4873-94fd-e2d42286a938 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-bbe7dbb7-8886-4cd3-b6ca-f480eb7301d4 req-10848836-9ef0-4c6f-8565-db88c39df305 service nova] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Received event network-vif-deleted-04afe31a-5ddd-475b-a353-9465641b535f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:13:48 user nova-compute[75205]: INFO nova.compute.manager [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] [instance: 34cf679a-1aa5-453a-abca-9db47cf798ef] Took 2.43 seconds to detach 3 volumes for instance.
Nov 14 19:13:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:13:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:13:49 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:13:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:13:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:49 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Deleted allocations for instance 34cf679a-1aa5-453a-abca-9db47cf798ef
Nov 14 19:13:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aad11ac1-ac24-4261-97c2-ab12995f1db0 tempest-TaggedBootDevicesTest-323420199 tempest-TaggedBootDevicesTest-323420199-project-member] Lock "34cf679a-1aa5-453a-abca-9db47cf798ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.141s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:13:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:13:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:03 user nova-compute[75205]: DEBUG nova.compute.manager [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:14:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:03 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:14:03 user nova-compute[75205]: INFO nova.compute.claims [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Claim successful on node user
Nov 14 19:14:04 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG nova.network.neutron [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:14:04 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:14:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG nova.policy [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67f99408d4954514aebc9d616ec5bcf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84244ff590a4bcaae6cc065b21cb12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:14:04 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Creating image(s)
Nov 14 19:14:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "/opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "/opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "/opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk 1073741824" returned: 0 in 0.055s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG nova.network.neutron [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Successfully created port: 0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Cannot resize image /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Ensure instance console log exists: /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG nova.network.neutron [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Successfully updated port: 0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquired lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG nova.network.neutron [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-c81f6e99-6e97-4f3b-824d-204cba21755b req-e4abe8e8-ab61-4291-beae-962b33b24325 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received event network-changed-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-c81f6e99-6e97-4f3b-824d-204cba21755b req-e4abe8e8-ab61-4291-beae-962b33b24325 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Refreshing instance network info cache due to event network-changed-0343e201-fc35-440c-9347-c394b44e22f6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c81f6e99-6e97-4f3b-824d-204cba21755b req-e4abe8e8-ab61-4291-beae-962b33b24325 service nova] Acquiring lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:14:05 user nova-compute[75205]: DEBUG nova.network.neutron [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.network.neutron [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updating instance_info_cache with network_info: [{"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Releasing lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.compute.manager [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Instance network_info: |[{"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c81f6e99-6e97-4f3b-824d-204cba21755b req-e4abe8e8-ab61-4291-beae-962b33b24325 service nova] Acquired lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.network.neutron [req-c81f6e99-6e97-4f3b-824d-204cba21755b req-e4abe8e8-ab61-4291-beae-962b33b24325 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Refreshing network info cache for port 0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Start _get_guest_xml network_info=[{"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:14:06 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:14:06 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1023753886',display_name='tempest-TestStampPattern-server-1023753886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1023753886',id=20,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd1svgJTYybDPh1lPR3DIJKAtUs1FjktJwKG4A3pEzS7EJ21cmmx2eyxvLZzWkBvHvPEmdFTD/HrC2z/t88W02YyxzcpPr7NmabWOAd9mQhAqkZ+Jzq7r3Uf9KQEyTcwQ==',key_name='tempest-TestStampPattern-1251953881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84244ff590a4bcaae6cc065b21cb12f',ramdisk_id='',reservation_id='r-5t00kcmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-719339764',owner_user_name='tempest-TestStampPattern-719339764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:14:05Z,user_data=None,user_id='67f99408d4954514aebc9d616ec5bcf0',uuid=6864c442-8284-4dd8-8165-ff891e5d5175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converting VIF {"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:58:e5,bridge_name='br-int',has_traffic_filtering=True,id=0343e201-fc35-440c-9347-c394b44e22f6,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0343e201-fc') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.objects.instance [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lazy-loading 'pci_devices' on Instance uuid 6864c442-8284-4dd8-8165-ff891e5d5175 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:14:06 user nova-compute[75205]:   <uuid>6864c442-8284-4dd8-8165-ff891e5d5175</uuid>
Nov 14 19:14:06 user nova-compute[75205]:   <name>instance-00000014</name>
Nov 14 19:14:06 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:14:06 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:14:06 user nova-compute[75205]:   <metadata>
Nov 14 19:14:06 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:14:06 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:14:06 user nova-compute[75205]:       <nova:name>tempest-TestStampPattern-server-1023753886</nova:name>
Nov 14 19:14:06 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:14:06</nova:creationTime>
Nov 14 19:14:06 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:14:06 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:14:06 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:14:06 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:14:06 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:14:06 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:14:06 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:14:06 user nova-compute[75205]:       <nova:owner>
Nov 14 19:14:06 user nova-compute[75205]:         <nova:user uuid="67f99408d4954514aebc9d616ec5bcf0">tempest-TestStampPattern-719339764-project-member</nova:user>
Nov 14 19:14:06 user nova-compute[75205]:         <nova:project uuid="b84244ff590a4bcaae6cc065b21cb12f">tempest-TestStampPattern-719339764</nova:project>
Nov 14 19:14:06 user nova-compute[75205]:       </nova:owner>
Nov 14 19:14:06 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:14:06 user nova-compute[75205]:       <nova:ports>
Nov 14 19:14:06 user nova-compute[75205]:         <nova:port uuid="0343e201-fc35-440c-9347-c394b44e22f6">
Nov 14 19:14:06 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:14:06 user nova-compute[75205]:         </nova:port>
Nov 14 19:14:06 user nova-compute[75205]:       </nova:ports>
Nov 14 19:14:06 user nova-compute[75205]:     </nova:instance>
Nov 14 19:14:06 user nova-compute[75205]:   </metadata>
Nov 14 19:14:06 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:14:06 user nova-compute[75205]:     <system>
Nov 14 19:14:06 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:14:06 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:14:06 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:14:06 user nova-compute[75205]:       <entry name="serial">6864c442-8284-4dd8-8165-ff891e5d5175</entry>
Nov 14 19:14:06 user nova-compute[75205]:       <entry name="uuid">6864c442-8284-4dd8-8165-ff891e5d5175</entry>
Nov 14 19:14:06 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:14:06 user nova-compute[75205]:     </system>
Nov 14 19:14:06 user nova-compute[75205]:   </sysinfo>
Nov 14 19:14:06 user nova-compute[75205]:   <os>
Nov 14 19:14:06 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:14:06 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:14:06 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:14:06 user nova-compute[75205]:   </os>
Nov 14 19:14:06 user nova-compute[75205]:   <features>
Nov 14 19:14:06 user nova-compute[75205]:     <acpi/>
Nov 14 19:14:06 user nova-compute[75205]:     <apic/>
Nov 14 19:14:06 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:14:06 user nova-compute[75205]:   </features>
Nov 14 19:14:06 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:14:06 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:14:06 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:14:06 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:14:06 user nova-compute[75205]:   </clock>
Nov 14 19:14:06 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:14:06 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:14:06 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:14:06 user nova-compute[75205]:   </cpu>
Nov 14 19:14:06 user nova-compute[75205]:   <devices>
Nov 14 19:14:06 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:14:06 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:14:06 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk"/>
Nov 14 19:14:06 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:14:06 user nova-compute[75205]:     </disk>
Nov 14 19:14:06 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:14:06 user nova-compute[75205]:       <mac address="fa:16:3e:55:58:e5"/>
Nov 14 19:14:06 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:14:06 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:14:06 user nova-compute[75205]:       <target dev="tap0343e201-fc"/>
Nov 14 19:14:06 user nova-compute[75205]:     </interface>
Nov 14 19:14:06 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:14:06 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/console.log" append="off"/>
Nov 14 19:14:06 user nova-compute[75205]:     </serial>
Nov 14 19:14:06 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:14:06 user nova-compute[75205]:     <video>
Nov 14 19:14:06 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:14:06 user nova-compute[75205]:     </video>
Nov 14 19:14:06 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:14:06 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:14:06 user nova-compute[75205]:     </rng>
Nov 14 19:14:06 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:14:06 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:14:06 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:14:06 user nova-compute[75205]:     </memballoon>
Nov 14 19:14:06 user nova-compute[75205]:   </devices>
Nov 14 19:14:06 user nova-compute[75205]: </domain>
Nov 14 19:14:06 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1023753886',display_name='tempest-TestStampPattern-server-1023753886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1023753886',id=20,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd1svgJTYybDPh1lPR3DIJKAtUs1FjktJwKG4A3pEzS7EJ21cmmx2eyxvLZzWkBvHvPEmdFTD/HrC2z/t88W02YyxzcpPr7NmabWOAd9mQhAqkZ+Jzq7r3Uf9KQEyTcwQ==',key_name='tempest-TestStampPattern-1251953881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84244ff590a4bcaae6cc065b21cb12f',ramdisk_id='',reservation_id='r-5t00kcmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-719339764',owner_user_name='tempest-TestStampPattern-719339764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:14:05Z,user_data=None,user_id='67f99408d4954514aebc9d616ec5bcf0',uuid=6864c442-8284-4dd8-8165-ff891e5d5175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converting VIF {"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:58:e5,bridge_name='br-int',has_traffic_filtering=True,id=0343e201-fc35-440c-9347-c394b44e22f6,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0343e201-fc') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG os_vif [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:58:e5,bridge_name='br-int',has_traffic_filtering=True,id=0343e201-fc35-440c-9347-c394b44e22f6,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0343e201-fc') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd69b0ff4-c4d6-5468-9587-27df9e96bfd5', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0343e201-fc, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0343e201-fc, col_values=(('qos', UUID('b0b34120-af11-479d-9afe-4d2a6df2564b')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0343e201-fc, col_values=(('external_ids', {'iface-id': '0343e201-fc35-440c-9347-c394b44e22f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:58:e5', 'vm-uuid': '6864c442-8284-4dd8-8165-ff891e5d5175'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:06 user nova-compute[75205]: INFO os_vif [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:58:e5,bridge_name='br-int',has_traffic_filtering=True,id=0343e201-fc35-440c-9347-c394b44e22f6,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0343e201-fc')
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] No VIF found with MAC fa:16:3e:55:58:e5, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.network.neutron [req-c81f6e99-6e97-4f3b-824d-204cba21755b req-e4abe8e8-ab61-4291-beae-962b33b24325 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updated VIF entry in instance network info cache for port 0343e201-fc35-440c-9347-c394b44e22f6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG nova.network.neutron [req-c81f6e99-6e97-4f3b-824d-204cba21755b req-e4abe8e8-ab61-4291-beae-962b33b24325 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updating instance_info_cache with network_info: [{"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c81f6e99-6e97-4f3b-824d-204cba21755b req-e4abe8e8-ab61-4291-beae-962b33b24325 service nova] Releasing lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:14:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-60596ae6-04f4-4abc-9b31-cac1659a0cd3 req-d92f2775-aa7c-409c-b355-989cf9939ac2 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received event network-vif-plugged-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-60596ae6-04f4-4abc-9b31-cac1659a0cd3 req-d92f2775-aa7c-409c-b355-989cf9939ac2 service nova] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-60596ae6-04f4-4abc-9b31-cac1659a0cd3 req-d92f2775-aa7c-409c-b355-989cf9939ac2 service nova] Lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-60596ae6-04f4-4abc-9b31-cac1659a0cd3 req-d92f2775-aa7c-409c-b355-989cf9939ac2 service nova] Lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-60596ae6-04f4-4abc-9b31-cac1659a0cd3 req-d92f2775-aa7c-409c-b355-989cf9939ac2 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] No waiting events found dispatching network-vif-plugged-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:07 user nova-compute[75205]: WARNING nova.compute.manager [req-60596ae6-04f4-4abc-9b31-cac1659a0cd3 req-d92f2775-aa7c-409c-b355-989cf9939ac2 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received unexpected event network-vif-plugged-0343e201-fc35-440c-9347-c394b44e22f6 for instance with vm_state building and task_state spawning.
Nov 14 19:14:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:08 user nova-compute[75205]: INFO nova.compute.manager [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Terminating instance
Nov 14 19:14:08 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Instance destroyed successfully.
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'resources' on Instance uuid 2d89bc07-90a1-49ef-8d67-e7263bd06e6d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1153990837',display_name='tempest-AttachVolumeNegativeTest-server-1153990837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1153990837',id=4,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOl5EMK6R+Wd5WVDrL2u3iwV3fRHuXKuwn8m63J4rBYC7r1sdx/LiORubJArdjMfGg/5TzdddKn64j7+kmufVtOpupS6nzhcaSQZx+0YV35u4/NobW9oHCUDRrtAdvyLQ==',key_name='tempest-keypair-1840008306',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-reah2drt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:08:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=2d89bc07-90a1-49ef-8d67-e7263bd06e6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "address": "fa:16:3e:7b:8e:52", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7dabbdd-80", "ovs_interfaceid": "e7dabbdd-806b-444d-87a4-0e944c8f8a88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=e7dabbdd-806b-444d-87a4-0e944c8f8a88,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7dabbdd-80') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG os_vif [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=e7dabbdd-806b-444d-87a4-0e944c8f8a88,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7dabbdd-80') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7dabbdd-80, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b926675a-b0a6-44ce-bac2-cdba9ee83dd4) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:09 user nova-compute[75205]: INFO os_vif [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=e7dabbdd-806b-444d-87a4-0e944c8f8a88,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7dabbdd-80')
Nov 14 19:14:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Deleting instance files /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d_del
Nov 14 19:14:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Deletion of /opt/stack/data/nova/instances/2d89bc07-90a1-49ef-8d67-e7263bd06e6d_del complete
Nov 14 19:14:09 user nova-compute[75205]: INFO nova.compute.manager [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 19:14:09 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:14:09 user nova-compute[75205]: INFO nova.compute.manager [None req-f93f64c1-3743-4f47-bf53-0f48b5a63933 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Unrescuing
Nov 14 19:14:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f93f64c1-3743-4f47-bf53-0f48b5a63933 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f93f64c1-3743-4f47-bf53-0f48b5a63933 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquired lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f93f64c1-3743-4f47-bf53-0f48b5a63933 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-737d4b8a-0b36-487e-be89-c78a0548fa55 req-05f46118-0513-41ed-a5e5-9b716abc2051 service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received event network-vif-deleted-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:09 user nova-compute[75205]: INFO nova.compute.manager [req-737d4b8a-0b36-487e-be89-c78a0548fa55 req-05f46118-0513-41ed-a5e5-9b716abc2051 service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Neutron deleted interface e7dabbdd-806b-444d-87a4-0e944c8f8a88; detaching it from the instance and deleting it from the info cache
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.network.neutron [req-737d4b8a-0b36-487e-be89-c78a0548fa55 req-05f46118-0513-41ed-a5e5-9b716abc2051 service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:09 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Took 0.63 seconds to deallocate network for instance.
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-737d4b8a-0b36-487e-be89-c78a0548fa55 req-05f46118-0513-41ed-a5e5-9b716abc2051 service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Detach interface failed, port_id=e7dabbdd-806b-444d-87a4-0e944c8f8a88, reason: Instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:14:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Instance spawned successfully.
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:14:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received event network-vif-plugged-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] Lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] Lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] No waiting events found dispatching network-vif-plugged-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:10 user nova-compute[75205]: WARNING nova.compute.manager [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received unexpected event network-vif-plugged-0343e201-fc35-440c-9347-c394b44e22f6 for instance with vm_state building and task_state spawning.
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received event network-vif-unplugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] Acquiring lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] No waiting events found dispatching network-vif-unplugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:10 user nova-compute[75205]: WARNING nova.compute.manager [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received unexpected event network-vif-unplugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 for instance with vm_state deleted and task_state None.
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received event network-vif-plugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] Acquiring lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] No waiting events found dispatching network-vif-plugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:10 user nova-compute[75205]: WARNING nova.compute.manager [req-626fba9c-e790-436f-9f2c-83c2c13f9891 req-41fe1f2c-80fb-489f-97af-42c75be9bd60 service nova] [instance: 2d89bc07-90a1-49ef-8d67-e7263bd06e6d] Received unexpected event network-vif-plugged-e7dabbdd-806b-444d-87a4-0e944c8f8a88 for instance with vm_state deleted and task_state None.
Nov 14 19:14:10 user nova-compute[75205]: INFO nova.compute.manager [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.compute.manager [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:14:10 user nova-compute[75205]: INFO nova.compute.manager [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Took 6.39 seconds to build instance.
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-58cbed5f-57f4-4a1f-b6ae-9cd61bf4096e tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.494s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:10 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Deleted allocations for instance 2d89bc07-90a1-49ef-8d67-e7263bd06e6d
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3b31dccd-f39a-4518-98de-f78ec03fa65d tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "2d89bc07-90a1-49ef-8d67-e7263bd06e6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f93f64c1-3743-4f47-bf53-0f48b5a63933 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updating instance_info_cache with network_info: [{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f93f64c1-3743-4f47-bf53-0f48b5a63933 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Releasing lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f93f64c1-3743-4f47-bf53-0f48b5a63933 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'flavor' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:11 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Instance destroyed successfully.
Nov 14 19:14:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-unplugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-unplugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:11 user nova-compute[75205]: WARNING nova.compute.manager [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-unplugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:14:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-changed-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Refreshing instance network info cache due to event network-changed-531d9209-139e-4463-9116-04f04ddca88e. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Acquiring lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Acquired lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:14:11 user nova-compute[75205]: DEBUG nova.network.neutron [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Refreshing network info cache for port 531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:14:12 user nova-compute[75205]: DEBUG nova.network.neutron [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updated VIF entry in instance network info cache for port 531d9209-139e-4463-9116-04f04ddca88e. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:14:12 user nova-compute[75205]: DEBUG nova.network.neutron [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updating instance_info_cache with network_info: [{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Releasing lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:14:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-changed-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Refreshing instance network info cache due to event network-changed-531d9209-139e-4463-9116-04f04ddca88e. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:14:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Acquiring lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:14:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Acquired lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:14:12 user nova-compute[75205]: DEBUG nova.network.neutron [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Refreshing network info cache for port 531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG nova.network.neutron [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updated VIF entry in instance network info cache for port 531d9209-139e-4463-9116-04f04ddca88e. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG nova.network.neutron [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updating instance_info_cache with network_info: [{"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Releasing lock "refresh_cache-92c7bf54-2b89-4a52-ab91-5ece2bd48b73" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:13 user nova-compute[75205]: WARNING nova.compute.manager [req-c7b87cfc-8844-499b-a97d-18ed0b46be77 req-2ed078cf-2109-489c-872b-15af5e06b5a9 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:14:13 user nova-compute[75205]: INFO nova.compute.manager [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Rescuing
Nov 14 19:14:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquired lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG nova.network.neutron [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-2958ba1e-d43c-468d-a0f5-92009d18d949 req-b6ee7c68-9f3f-44db-a326-71008ecc6b68 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2958ba1e-d43c-468d-a0f5-92009d18d949 req-b6ee7c68-9f3f-44db-a326-71008ecc6b68 service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2958ba1e-d43c-468d-a0f5-92009d18d949 req-b6ee7c68-9f3f-44db-a326-71008ecc6b68 service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2958ba1e-d43c-468d-a0f5-92009d18d949 req-b6ee7c68-9f3f-44db-a326-71008ecc6b68 service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-2958ba1e-d43c-468d-a0f5-92009d18d949 req-b6ee7c68-9f3f-44db-a326-71008ecc6b68 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:14 user nova-compute[75205]: WARNING nova.compute.manager [req-2958ba1e-d43c-468d-a0f5-92009d18d949 req-b6ee7c68-9f3f-44db-a326-71008ecc6b68 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:14:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG nova.network.neutron [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Updating instance_info_cache with network_info: [{"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Releasing lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:15 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Instance destroyed successfully.
Nov 14 19:14:15 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Attempting rescue
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75205) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Instance directory exists: not creating {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 19:14:15 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Creating image(s)
Nov 14 19:14:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7803fcca-eed8-4088-b1dc-e0908dcecaa4 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.240s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue" returned: 0 in 0.053s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'migration_context' on Instance uuid 7803fcca-eed8-4088-b1dc-e0908dcecaa4 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.base [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<7803fcca-eed8-4088-b1dc-e0908dcecaa4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Start _get_guest_xml network_info=[{"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "vif_mac": "fa:16:3e:ee:dd:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'resources' on Instance uuid 7803fcca-eed8-4088-b1dc-e0908dcecaa4 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.base [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<7803fcca-eed8-4088-b1dc-e0908dcecaa4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'numa_topology' on Instance uuid 7803fcca-eed8-4088-b1dc-e0908dcecaa4 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.base [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<7803fcca-eed8-4088-b1dc-e0908dcecaa4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:14:15 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:14:15 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7803fcca-eed8-4088-b1dc-e0908dcecaa4 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.base [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<7803fcca-eed8-4088-b1dc-e0908dcecaa4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-566278879',display_name='tempest-ServerRescueNegativeTestJSON-server-566278879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-566278879',id=17,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-3ob9ypcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:12:32Z,user_data=None,user_id='1b03af1014734b1a8d4c2633756070e8',uuid=7803fcca-eed8-4088-b1dc-e0908dcecaa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "vif_mac": "fa:16:3e:ee:dd:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "vif_mac": "fa:16:3e:ee:dd:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:dd:41,bridge_name='br-int',has_traffic_filtering=True,id=a15f5508-d912-41f1-8459-a67ea57e481a,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15f5508-d9') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'pci_devices' on Instance uuid 7803fcca-eed8-4088-b1dc-e0908dcecaa4 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.objects.base [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<7803fcca-eed8-4088-b1dc-e0908dcecaa4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:14:15 user nova-compute[75205]:   <uuid>7803fcca-eed8-4088-b1dc-e0908dcecaa4</uuid>
Nov 14 19:14:15 user nova-compute[75205]:   <name>instance-00000011</name>
Nov 14 19:14:15 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:14:15 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:14:15 user nova-compute[75205]:   <metadata>
Nov 14 19:14:15 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:14:15 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:14:15 user nova-compute[75205]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-566278879</nova:name>
Nov 14 19:14:15 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:14:15</nova:creationTime>
Nov 14 19:14:15 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:14:15 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:14:15 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:14:15 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:14:15 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:14:15 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:14:15 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:14:15 user nova-compute[75205]:       <nova:owner>
Nov 14 19:14:15 user nova-compute[75205]:         <nova:user uuid="1b03af1014734b1a8d4c2633756070e8">tempest-ServerRescueNegativeTestJSON-278369752-project-member</nova:user>
Nov 14 19:14:15 user nova-compute[75205]:         <nova:project uuid="7eabb88364cd4173ba71aa8920d40954">tempest-ServerRescueNegativeTestJSON-278369752</nova:project>
Nov 14 19:14:15 user nova-compute[75205]:       </nova:owner>
Nov 14 19:14:15 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:14:15 user nova-compute[75205]:       <nova:ports>
Nov 14 19:14:15 user nova-compute[75205]:         <nova:port uuid="a15f5508-d912-41f1-8459-a67ea57e481a">
Nov 14 19:14:15 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:14:15 user nova-compute[75205]:         </nova:port>
Nov 14 19:14:15 user nova-compute[75205]:       </nova:ports>
Nov 14 19:14:15 user nova-compute[75205]:     </nova:instance>
Nov 14 19:14:15 user nova-compute[75205]:   </metadata>
Nov 14 19:14:15 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:14:15 user nova-compute[75205]:     <system>
Nov 14 19:14:15 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:14:15 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:14:15 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:14:15 user nova-compute[75205]:       <entry name="serial">7803fcca-eed8-4088-b1dc-e0908dcecaa4</entry>
Nov 14 19:14:15 user nova-compute[75205]:       <entry name="uuid">7803fcca-eed8-4088-b1dc-e0908dcecaa4</entry>
Nov 14 19:14:15 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:14:15 user nova-compute[75205]:     </system>
Nov 14 19:14:15 user nova-compute[75205]:   </sysinfo>
Nov 14 19:14:15 user nova-compute[75205]:   <os>
Nov 14 19:14:15 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:14:15 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:14:15 user nova-compute[75205]:   </os>
Nov 14 19:14:15 user nova-compute[75205]:   <features>
Nov 14 19:14:15 user nova-compute[75205]:     <acpi/>
Nov 14 19:14:15 user nova-compute[75205]:     <apic/>
Nov 14 19:14:15 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:14:15 user nova-compute[75205]:   </features>
Nov 14 19:14:15 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:14:15 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:14:15 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:14:15 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:14:15 user nova-compute[75205]:   </clock>
Nov 14 19:14:15 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:14:15 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:14:15 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:14:15 user nova-compute[75205]:   </cpu>
Nov 14 19:14:15 user nova-compute[75205]:   <devices>
Nov 14 19:14:15 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:14:15 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:14:15 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue"/>
Nov 14 19:14:15 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:14:15 user nova-compute[75205]:     </disk>
Nov 14 19:14:15 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:14:15 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:14:15 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk"/>
Nov 14 19:14:15 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:14:15 user nova-compute[75205]:     </disk>
Nov 14 19:14:15 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:14:15 user nova-compute[75205]:       <mac address="fa:16:3e:ee:dd:41"/>
Nov 14 19:14:15 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:14:15 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:14:15 user nova-compute[75205]:       <target dev="tapa15f5508-d9"/>
Nov 14 19:14:15 user nova-compute[75205]:     </interface>
Nov 14 19:14:15 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:14:15 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/console.log" append="off"/>
Nov 14 19:14:15 user nova-compute[75205]:     </serial>
Nov 14 19:14:15 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:14:15 user nova-compute[75205]:     <video>
Nov 14 19:14:15 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:14:15 user nova-compute[75205]:     </video>
Nov 14 19:14:15 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:14:15 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:14:15 user nova-compute[75205]:     </rng>
Nov 14 19:14:15 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:14:15 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:14:15 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:14:15 user nova-compute[75205]:     </memballoon>
Nov 14 19:14:15 user nova-compute[75205]:   </devices>
Nov 14 19:14:15 user nova-compute[75205]: </domain>
Nov 14 19:14:15 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:14:15 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Instance destroyed successfully.
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:14:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No VIF found with MAC fa:16:3e:ee:dd:41, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f93f64c1-3743-4f47-bf53-0f48b5a63933 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:16 user nova-compute[75205]: WARNING nova.compute.manager [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:14:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-vif-unplugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] No waiting events found dispatching network-vif-unplugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:16 user nova-compute[75205]: WARNING nova.compute.manager [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received unexpected event network-vif-unplugged-a15f5508-d912-41f1-8459-a67ea57e481a for instance with vm_state active and task_state rescuing.
Nov 14 19:14:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] No waiting events found dispatching network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:16 user nova-compute[75205]: WARNING nova.compute.manager [req-f61dfffd-03cc-44fe-bd1c-6d5f23b58c53 req-e9388489-9986-4c3d-b6ef-6b0d2757d83a service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received unexpected event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a for instance with vm_state active and task_state rescuing.
Nov 14 19:14:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] No waiting events found dispatching network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:18 user nova-compute[75205]: WARNING nova.compute.manager [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received unexpected event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a for instance with vm_state active and task_state rescuing.
Nov 14 19:14:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] No waiting events found dispatching network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:18 user nova-compute[75205]: WARNING nova.compute.manager [req-9b5d5e7b-b873-4e80-a74f-d098f89e871d req-647f5951-900d-4a20-8fb8-a8b0f8baf3bd service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received unexpected event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a for instance with vm_state active and task_state rescuing.
Nov 14 19:14:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-de36a584-cec6-41ec-b0e6-18d7cb82a09d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:14:20 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:22 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:22 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:14:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:24 user nova-compute[75205]: INFO nova.compute.manager [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Terminating instance
Nov 14 19:14:24 user nova-compute[75205]: DEBUG nova.compute.manager [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-35f39bb8-5597-4ac8-a061-8bb71f04b942 req-da284e44-6a12-4a2a-a123-b3eea50f7a59 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received event network-vif-unplugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35f39bb8-5597-4ac8-a061-8bb71f04b942 req-da284e44-6a12-4a2a-a123-b3eea50f7a59 service nova] Acquiring lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35f39bb8-5597-4ac8-a061-8bb71f04b942 req-da284e44-6a12-4a2a-a123-b3eea50f7a59 service nova] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35f39bb8-5597-4ac8-a061-8bb71f04b942 req-da284e44-6a12-4a2a-a123-b3eea50f7a59 service nova] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-35f39bb8-5597-4ac8-a061-8bb71f04b942 req-da284e44-6a12-4a2a-a123-b3eea50f7a59 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] No waiting events found dispatching network-vif-unplugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-35f39bb8-5597-4ac8-a061-8bb71f04b942 req-da284e44-6a12-4a2a-a123-b3eea50f7a59 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received event network-vif-unplugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:25 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Instance destroyed successfully.
Nov 14 19:14:25 user nova-compute[75205]: DEBUG nova.objects.instance [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lazy-loading 'resources' on Instance uuid 1f24f442-1547-4f20-ba7c-f7790dcc37af {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2146645887',display_name='tempest-VolumesAdminNegativeTest-server-2146645887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2146645887',id=5,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMlslY8PczHJAYRFDpr6styuNSzMMwsJwh1nfBGdF3FZWnRgSsqpEbRMhCCAGoLGOYjQrtBOF0nB5hrur5PEyQwz/y3ORSMwSwYAd7OYnRgBd3QFK243abTe8HSkuY3oA==',key_name='tempest-keypair-524423915',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ba7425d60794409b74ed4fe0e902536',ramdisk_id='',reservation_id='r-srppx44e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-368867561',owner_user_name='tempest-VolumesAdminNegativeTest-368867561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53dc67514dda4ef7b51122f81c6feb02',uuid=1f24f442-1547-4f20-ba7c-f7790dcc37af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converting VIF {"id": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "address": "fa:16:3e:f4:dc:26", "network": {"id": "699e2944-40ca-41cc-b9f3-bd891a53c392", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1536605310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ba7425d60794409b74ed4fe0e902536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff69d5ef-66", "ovs_interfaceid": "ff69d5ef-6600-4426-a4e1-f0116599ebfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=ff69d5ef-6600-4426-a4e1-f0116599ebfc,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff69d5ef-66') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG os_vif [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=ff69d5ef-6600-4426-a4e1-f0116599ebfc,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff69d5ef-66') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff69d5ef-66, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dac71f85-35d4-4040-a72e-0519a9e1ad99) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:25 user nova-compute[75205]: INFO os_vif [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=ff69d5ef-6600-4426-a4e1-f0116599ebfc,network=Network(699e2944-40ca-41cc-b9f3-bd891a53c392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff69d5ef-66')
Nov 14 19:14:25 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Deleting instance files /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af_del
Nov 14 19:14:25 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Deletion of /opt/stack/data/nova/instances/1f24f442-1547-4f20-ba7c-f7790dcc37af_del complete
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:25 user nova-compute[75205]: INFO nova.compute.manager [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 19:14:25 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:14:25 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:14:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:14:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:26 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Error from libvirt while getting description of instance-00000005: [Error Code 42] Domain not found: no domain with matching uuid '1f24f442-1547-4f20-ba7c-f7790dcc37af' (instance-00000005): libvirt.libvirtError: Domain not found: no domain with matching uuid '1f24f442-1547-4f20-ba7c-f7790dcc37af' (instance-00000005)
Nov 14 19:14:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:14:27 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:14:27 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7416MB free_disk=25.154102325439453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:27 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Took 1.35 seconds to deallocate network for instance.
Nov 14 19:14:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-ea676e42-d5db-402e-85b7-2ba59ffc2b9b req-346a9324-6055-48e1-918d-f49f517b06f7 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received event network-vif-plugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ea676e42-d5db-402e-85b7-2ba59ffc2b9b req-346a9324-6055-48e1-918d-f49f517b06f7 service nova] Acquiring lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ea676e42-d5db-402e-85b7-2ba59ffc2b9b req-346a9324-6055-48e1-918d-f49f517b06f7 service nova] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ea676e42-d5db-402e-85b7-2ba59ffc2b9b req-346a9324-6055-48e1-918d-f49f517b06f7 service nova] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-ea676e42-d5db-402e-85b7-2ba59ffc2b9b req-346a9324-6055-48e1-918d-f49f517b06f7 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] No waiting events found dispatching network-vif-plugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:27 user nova-compute[75205]: WARNING nova.compute.manager [req-ea676e42-d5db-402e-85b7-2ba59ffc2b9b req-346a9324-6055-48e1-918d-f49f517b06f7 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received unexpected event network-vif-plugged-ff69d5ef-6600-4426-a4e1-f0116599ebfc for instance with vm_state deleted and task_state None.
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-ea676e42-d5db-402e-85b7-2ba59ffc2b9b req-346a9324-6055-48e1-918d-f49f517b06f7 service nova] [instance: 1f24f442-1547-4f20-ba7c-f7790dcc37af] Received event network-vif-deleted-ff69d5ef-6600-4426-a4e1-f0116599ebfc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1f24f442-1547-4f20-ba7c-f7790dcc37af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance c7744d82-c045-4602-9d7a-83f7d331a77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6864c442-8284-4dd8-8165-ff891e5d5175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.541s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] There are 0 instances to clean {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75205) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 19:14:28 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:14:28 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:14:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:28 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Deleted allocations for instance 1f24f442-1547-4f20-ba7c-f7790dcc37af
Nov 14 19:14:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1fff0a58-ad64-4d71-aa79-af6b1ff382c1 tempest-VolumesAdminNegativeTest-368867561 tempest-VolumesAdminNegativeTest-368867561-project-member] Lock "1f24f442-1547-4f20-ba7c-f7790dcc37af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.603s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:28 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:28 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:14:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:14:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:14:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 6e3657fa-d795-4732-852a-158c68452387 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 7803fcca-eed8-4088-b1dc-e0908dcecaa4 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid c7744d82-c045-4602-9d7a-83f7d331a77e {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 6864c442-8284-4dd8-8165-ff891e5d5175 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "6e3657fa-d795-4732-852a-158c68452387" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "6e3657fa-d795-4732-852a-158c68452387" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "d453ca1b-600f-40a9-9478-60ae619302ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "d453ca1b-600f-40a9-9478-60ae619302ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "6e3657fa-d795-4732-852a-158c68452387" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:43 user nova-compute[75205]: INFO nova.compute.manager [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Detaching volume 07a2629c-7268-42d8-9903-9cefe7fe77e4
Nov 14 19:14:43 user nova-compute[75205]: INFO nova.virt.block_device [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Attempting to driver detach volume 07a2629c-7268-42d8-9903-9cefe7fe77e4 from mountpoint /dev/vdb
Nov 14 19:14:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Attempting to detach device vdb from instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:14:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:14:43 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:14:43 user nova-compute[75205]:   <source dev="/dev/sdi"/>
Nov 14 19:14:43 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:14:43 user nova-compute[75205]:   <serial>07a2629c-7268-42d8-9903-9cefe7fe77e4</serial>
Nov 14 19:14:43 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:14:43 user nova-compute[75205]: </disk>
Nov 14 19:14:43 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:14:43 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Successfully detached device vdb from instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 from the persistent domain config.
Nov 14 19:14:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:14:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:14:43 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:14:43 user nova-compute[75205]:   <source dev="/dev/sdi"/>
Nov 14 19:14:43 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:14:43 user nova-compute[75205]:   <serial>07a2629c-7268-42d8-9903-9cefe7fe77e4</serial>
Nov 14 19:14:43 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:14:43 user nova-compute[75205]: </disk>
Nov 14 19:14:43 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:14:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:14:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "934d0407-7d12-4edb-99d2-8558be6427d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "934d0407-7d12-4edb-99d2-8558be6427d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:14:55 user nova-compute[75205]: INFO nova.compute.claims [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Claim successful on node user
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Refreshing inventories for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Updating ProviderTree inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Refreshing aggregate associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, aggregates: None {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Refreshing trait associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, traits: HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:14:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.policy [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f89ca9b3c52040acbc46581ac5cf55b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55021da245654f6392681359d51cbc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:14:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Creating image(s)
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "/opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "/opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "/opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk 1073741824" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG nova.network.neutron [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Successfully created port: b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Checking if we can resize image /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Cannot resize image /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Ensure instance console log exists: /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Successfully updated port: b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquired lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-210ad238-042c-48b9-8349-0b3892d552c6 req-c821c903-c11c-4f4f-affb-094771077e62 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received event network-changed-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-210ad238-042c-48b9-8349-0b3892d552c6 req-c821c903-c11c-4f4f-affb-094771077e62 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Refreshing instance network info cache due to event network-changed-b53ded48-7665-4249-884c-8c0938a57fa0. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-210ad238-042c-48b9-8349-0b3892d552c6 req-c821c903-c11c-4f4f-affb-094771077e62 service nova] Acquiring lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updating instance_info_cache with network_info: [{"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Releasing lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Instance network_info: |[{"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-210ad238-042c-48b9-8349-0b3892d552c6 req-c821c903-c11c-4f4f-affb-094771077e62 service nova] Acquired lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.network.neutron [req-210ad238-042c-48b9-8349-0b3892d552c6 req-c821c903-c11c-4f4f-affb-094771077e62 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Refreshing network info cache for port b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Start _get_guest_xml network_info=[{"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:14:57 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:14:57 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:14:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2026428892',display_name='tempest-ServerActionsTestOtherA-server-2026428892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2026428892',id=21,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3OJYMfErFiTGe/qVImPNNpMoleZ3J9mAlhBnKRLLztrPxOuSUjWBVerPUHNAmA4WwUUZXCuLX5O2r/5K813hJJaeAm4LX+jg/1ArdxTUJxjig4g1+w8aJwtp9ZiKaoQA==',key_name='tempest-keypair-1933539898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-jrk0njx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=934d0407-7d12-4edb-99d2-8558be6427d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4f:58,bridge_name='br-int',has_traffic_filtering=True,id=b53ded48-7665-4249-884c-8c0938a57fa0,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53ded48-76') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'pci_devices' on Instance uuid 934d0407-7d12-4edb-99d2-8558be6427d6 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:14:57 user nova-compute[75205]:   <uuid>934d0407-7d12-4edb-99d2-8558be6427d6</uuid>
Nov 14 19:14:57 user nova-compute[75205]:   <name>instance-00000015</name>
Nov 14 19:14:57 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:14:57 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:14:57 user nova-compute[75205]:   <metadata>
Nov 14 19:14:57 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:14:57 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:14:57 user nova-compute[75205]:       <nova:name>tempest-ServerActionsTestOtherA-server-2026428892</nova:name>
Nov 14 19:14:57 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:14:57</nova:creationTime>
Nov 14 19:14:57 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:14:57 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:14:57 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:14:57 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:14:57 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:14:57 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:14:57 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:14:57 user nova-compute[75205]:       <nova:owner>
Nov 14 19:14:57 user nova-compute[75205]:         <nova:user uuid="f89ca9b3c52040acbc46581ac5cf55b9">tempest-ServerActionsTestOtherA-410645410-project-member</nova:user>
Nov 14 19:14:57 user nova-compute[75205]:         <nova:project uuid="55021da245654f6392681359d51cbc9d">tempest-ServerActionsTestOtherA-410645410</nova:project>
Nov 14 19:14:57 user nova-compute[75205]:       </nova:owner>
Nov 14 19:14:57 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:14:57 user nova-compute[75205]:       <nova:ports>
Nov 14 19:14:57 user nova-compute[75205]:         <nova:port uuid="b53ded48-7665-4249-884c-8c0938a57fa0">
Nov 14 19:14:57 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 19:14:57 user nova-compute[75205]:         </nova:port>
Nov 14 19:14:57 user nova-compute[75205]:       </nova:ports>
Nov 14 19:14:57 user nova-compute[75205]:     </nova:instance>
Nov 14 19:14:57 user nova-compute[75205]:   </metadata>
Nov 14 19:14:57 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:14:57 user nova-compute[75205]:     <system>
Nov 14 19:14:57 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:14:57 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:14:57 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:14:57 user nova-compute[75205]:       <entry name="serial">934d0407-7d12-4edb-99d2-8558be6427d6</entry>
Nov 14 19:14:57 user nova-compute[75205]:       <entry name="uuid">934d0407-7d12-4edb-99d2-8558be6427d6</entry>
Nov 14 19:14:57 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:14:57 user nova-compute[75205]:     </system>
Nov 14 19:14:57 user nova-compute[75205]:   </sysinfo>
Nov 14 19:14:57 user nova-compute[75205]:   <os>
Nov 14 19:14:57 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:14:57 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:14:57 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:14:57 user nova-compute[75205]:   </os>
Nov 14 19:14:57 user nova-compute[75205]:   <features>
Nov 14 19:14:57 user nova-compute[75205]:     <acpi/>
Nov 14 19:14:57 user nova-compute[75205]:     <apic/>
Nov 14 19:14:57 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:14:57 user nova-compute[75205]:   </features>
Nov 14 19:14:57 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:14:57 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:14:57 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:14:57 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:14:57 user nova-compute[75205]:   </clock>
Nov 14 19:14:57 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:14:57 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:14:57 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:14:57 user nova-compute[75205]:   </cpu>
Nov 14 19:14:57 user nova-compute[75205]:   <devices>
Nov 14 19:14:57 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:14:57 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:14:57 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk"/>
Nov 14 19:14:57 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:14:57 user nova-compute[75205]:     </disk>
Nov 14 19:14:57 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:14:57 user nova-compute[75205]:       <mac address="fa:16:3e:b6:4f:58"/>
Nov 14 19:14:57 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:14:57 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:14:57 user nova-compute[75205]:       <target dev="tapb53ded48-76"/>
Nov 14 19:14:57 user nova-compute[75205]:     </interface>
Nov 14 19:14:57 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:14:57 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/console.log" append="off"/>
Nov 14 19:14:57 user nova-compute[75205]:     </serial>
Nov 14 19:14:57 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:14:57 user nova-compute[75205]:     <video>
Nov 14 19:14:57 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:14:57 user nova-compute[75205]:     </video>
Nov 14 19:14:57 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:14:57 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:14:57 user nova-compute[75205]:     </rng>
Nov 14 19:14:57 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:14:57 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:14:57 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:14:57 user nova-compute[75205]:     </memballoon>
Nov 14 19:14:57 user nova-compute[75205]:   </devices>
Nov 14 19:14:57 user nova-compute[75205]: </domain>
Nov 14 19:14:57 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:14:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2026428892',display_name='tempest-ServerActionsTestOtherA-server-2026428892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2026428892',id=21,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3OJYMfErFiTGe/qVImPNNpMoleZ3J9mAlhBnKRLLztrPxOuSUjWBVerPUHNAmA4WwUUZXCuLX5O2r/5K813hJJaeAm4LX+jg/1ArdxTUJxjig4g1+w8aJwtp9ZiKaoQA==',key_name='tempest-keypair-1933539898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-jrk0njx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=934d0407-7d12-4edb-99d2-8558be6427d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4f:58,bridge_name='br-int',has_traffic_filtering=True,id=b53ded48-7665-4249-884c-8c0938a57fa0,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53ded48-76') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG os_vif [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4f:58,bridge_name='br-int',has_traffic_filtering=True,id=b53ded48-7665-4249-884c-8c0938a57fa0,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53ded48-76') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '287ee396-3cf4-5d43-b9af-0c823e8dc971', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb53ded48-76, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb53ded48-76, col_values=(('qos', UUID('88baefba-3078-43b0-9f45-e9180ca4868e')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb53ded48-76, col_values=(('external_ids', {'iface-id': 'b53ded48-7665-4249-884c-8c0938a57fa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:4f:58', 'vm-uuid': '934d0407-7d12-4edb-99d2-8558be6427d6'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:57 user nova-compute[75205]: INFO os_vif [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4f:58,bridge_name='br-int',has_traffic_filtering=True,id=b53ded48-7665-4249-884c-8c0938a57fa0,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53ded48-76')
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:14:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No VIF found with MAC fa:16:3e:b6:4f:58, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-210ad238-042c-48b9-8349-0b3892d552c6 req-c821c903-c11c-4f4f-affb-094771077e62 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updated VIF entry in instance network info cache for port b53ded48-7665-4249-884c-8c0938a57fa0. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-210ad238-042c-48b9-8349-0b3892d552c6 req-c821c903-c11c-4f4f-affb-094771077e62 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updating instance_info_cache with network_info: [{"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-210ad238-042c-48b9-8349-0b3892d552c6 req-c821c903-c11c-4f4f-affb-094771077e62 service nova] Releasing lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-b32b4034-0b72-433d-bc9a-08cbe8df9596 req-9544baa7-5891-483f-86cf-2674ee33f0bb service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received event network-changed-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-b32b4034-0b72-433d-bc9a-08cbe8df9596 req-9544baa7-5891-483f-86cf-2674ee33f0bb service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Refreshing instance network info cache due to event network-changed-38be7883-5d11-431e-8a4c-7d70b2839e88. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b32b4034-0b72-433d-bc9a-08cbe8df9596 req-9544baa7-5891-483f-86cf-2674ee33f0bb service nova] Acquiring lock "refresh_cache-cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b32b4034-0b72-433d-bc9a-08cbe8df9596 req-9544baa7-5891-483f-86cf-2674ee33f0bb service nova] Acquired lock "refresh_cache-cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-b32b4034-0b72-433d-bc9a-08cbe8df9596 req-9544baa7-5891-483f-86cf-2674ee33f0bb service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Refreshing network info cache for port 38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-b32b4034-0b72-433d-bc9a-08cbe8df9596 req-9544baa7-5891-483f-86cf-2674ee33f0bb service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Updated VIF entry in instance network info cache for port 38be7883-5d11-431e-8a4c-7d70b2839e88. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-b32b4034-0b72-433d-bc9a-08cbe8df9596 req-9544baa7-5891-483f-86cf-2674ee33f0bb service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Updating instance_info_cache with network_info: [{"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:14:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b32b4034-0b72-433d-bc9a-08cbe8df9596 req-9544baa7-5891-483f-86cf-2674ee33f0bb service nova] Releasing lock "refresh_cache-cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:14:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:14:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-c2c62349-f8b7-4b73-8456-8a346d0e70e5 req-6ad53ca4-fd92-46fe-94cc-b845e20d2cd0 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received event network-vif-plugged-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:14:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c2c62349-f8b7-4b73-8456-8a346d0e70e5 req-6ad53ca4-fd92-46fe-94cc-b845e20d2cd0 service nova] Acquiring lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:14:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c2c62349-f8b7-4b73-8456-8a346d0e70e5 req-6ad53ca4-fd92-46fe-94cc-b845e20d2cd0 service nova] Lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:14:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c2c62349-f8b7-4b73-8456-8a346d0e70e5 req-6ad53ca4-fd92-46fe-94cc-b845e20d2cd0 service nova] Lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:14:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-c2c62349-f8b7-4b73-8456-8a346d0e70e5 req-6ad53ca4-fd92-46fe-94cc-b845e20d2cd0 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] No waiting events found dispatching network-vif-plugged-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:14:59 user nova-compute[75205]: WARNING nova.compute.manager [req-c2c62349-f8b7-4b73-8456-8a346d0e70e5 req-6ad53ca4-fd92-46fe-94cc-b845e20d2cd0 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received unexpected event network-vif-plugged-b53ded48-7665-4249-884c-8c0938a57fa0 for instance with vm_state building and task_state spawning.
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lazy-loading 'flavor' on Instance uuid cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:00 user nova-compute[75205]: INFO nova.compute.manager [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Attaching volume 00ceac4f-4b21-4cde-b03c-2cb3929d3f67 to /dev/sdc
Nov 14 19:15:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG os_brick.utils [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4149b13e-e2eb-4844-886b-1f7a5f6b723d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0534d23-8cd6-41d1-9605-6e6f8844cf44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1488f2-0cda-45f4-92ec-3c49aec33f3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb6657d-566d-4d22-9921-07e5a7a71dfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:15:00 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:15:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e4e59b-3a01-412d-8722-c66d1f2c260b]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG os_brick.utils [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:15:00 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Updating existing volume attachment record: 6f6f1b6a-16db-428e-92ca-93d38a4052ac {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:15:01 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Instance spawned successfully.
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.compute.manager [req-d326ae99-c1c6-4f84-a1d9-2cf9f0459099 req-f6298316-af80-4e70-a795-9b5c57979348 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received event network-vif-plugged-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d326ae99-c1c6-4f84-a1d9-2cf9f0459099 req-f6298316-af80-4e70-a795-9b5c57979348 service nova] Acquiring lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d326ae99-c1c6-4f84-a1d9-2cf9f0459099 req-f6298316-af80-4e70-a795-9b5c57979348 service nova] Lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d326ae99-c1c6-4f84-a1d9-2cf9f0459099 req-f6298316-af80-4e70-a795-9b5c57979348 service nova] Lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.compute.manager [req-d326ae99-c1c6-4f84-a1d9-2cf9f0459099 req-f6298316-af80-4e70-a795-9b5c57979348 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] No waiting events found dispatching network-vif-plugged-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:01 user nova-compute[75205]: WARNING nova.compute.manager [req-d326ae99-c1c6-4f84-a1d9-2cf9f0459099 req-f6298316-af80-4e70-a795-9b5c57979348 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received unexpected event network-vif-plugged-b53ded48-7665-4249-884c-8c0938a57fa0 for instance with vm_state building and task_state spawning.
Nov 14 19:15:01 user nova-compute[75205]: INFO nova.compute.manager [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 14 19:15:01 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:15:01 user nova-compute[75205]: INFO nova.compute.manager [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Took 6.70 seconds to build instance.
Nov 14 19:15:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0936ca8f-446a-4bbd-a38b-2dbd29ac7561 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "934d0407-7d12-4edb-99d2-8558be6427d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.923s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:02 user nova-compute[75205]: INFO nova.compute.manager [None req-a545db10-d577-43b3-81a6-f8b2280e1907 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Unrescuing
Nov 14 19:15:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a545db10-d577-43b3-81a6-f8b2280e1907 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a545db10-d577-43b3-81a6-f8b2280e1907 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquired lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a545db10-d577-43b3-81a6-f8b2280e1907 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "72306b76-6bec-433a-ac37-e28218c3a265" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:15:02 user nova-compute[75205]: INFO nova.compute.claims [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Claim successful on node user
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a545db10-d577-43b3-81a6-f8b2280e1907 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updating instance_info_cache with network_info: [{"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a545db10-d577-43b3-81a6-f8b2280e1907 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Releasing lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.objects.instance [None req-a545db10-d577-43b3-81a6-f8b2280e1907 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'flavor' on Instance uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:02 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:15:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.policy [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '792e949c53df4fe390f93c0118590bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42501d5d4964f49b8fe62e9c9c2bd24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.compute.manager [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:15:03 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Creating image(s)
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "/opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "/opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "/opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:03 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Instance destroyed successfully.
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.221s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk 1073741824" returned: 0 in 0.052s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-unplugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-unplugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:03 user nova-compute[75205]: WARNING nova.compute.manager [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-unplugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:03 user nova-compute[75205]: WARNING nova.compute.manager [req-cc9fe266-e1bf-4241-84e1-8349711089e0 req-ca2a2adb-d493-46ce-a94c-6448a9926fa6 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.248s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.network.neutron [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Successfully created port: e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Cannot resize image /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Ensure instance console log exists: /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:04 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 is timed out.
Nov 14 19:15:04 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Successfully detached device vdb from instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 from the live domain config.
Nov 14 19:15:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fODSxAQJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:15:04 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[755c4e50-6fdc-44a4-bb4d-a238f908568b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:15:04 user nova-compute[75205]: No targets found.
Nov 14 19:15:04 user nova-compute[75205]: iSNS:
Nov 14 19:15:04 user nova-compute[75205]: No targets found.
Nov 14 19:15:04 user nova-compute[75205]: STATIC:
Nov 14 19:15:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4
Nov 14 19:15:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:15:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:15:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:15:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:15:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:15:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:15:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:15:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:15:04 user nova-compute[75205]: FIRMWARE:
Nov 14 19:15:04 user nova-compute[75205]: No targets found.
Nov 14 19:15:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:15:04 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:15:04 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3ea094-acc4-4302-891a-69d0b40efc86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f042a7-c162-4a74-9e5b-017224f19482]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:15:04 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:15:04 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:15:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:15:04 user nova-compute[75205]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 (non-flash)
Nov 14 19:15:04 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:15:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb741f08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4'): ({'sdi'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Removing single pathed devices sdi {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b2e164-1211-42de-91fc-c07952856519]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d470cd2-9796-4303-8a58-8e3d9fcb7d80]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Flushing IO for device /dev/sdi {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4747d6f8-b606-4a45-bdf8-27097c19a835]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG nova.network.neutron [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Successfully updated port: e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.055s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14c1b63-ae53-4623-8447-6a3f3d7c4387]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] SCSI volumes sdi have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "refresh_cache-72306b76-6bec-433a-ac37-e28218c3a265" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquired lock "refresh_cache-72306b76-6bec-433a-ac37-e28218c3a265" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG nova.network.neutron [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa417a9-6536-43f8-a021-2192522cbd58]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG nova.network.neutron [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7dcc7c-612a-4cf7-8dec-b589314bf9dd]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4, portal: 172.16.0.220,3260]
Nov 14 19:15:04 user nova-compute[75205]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4, portal: 172.16.0.220,3260] successful.
Nov 14 19:15:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07a2629c-7268-42d8-9903-9cefe7fe77e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f606d-3848-4384-a8cb-276695db9349]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] <== disconnect_volume: return (369ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.network.neutron [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Updating instance_info_cache with network_info: [{"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Releasing lock "refresh_cache-72306b76-6bec-433a-ac37-e28218c3a265" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.compute.manager [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Instance network_info: |[{"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Start _get_guest_xml network_info=[{"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:15:05 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:15:05 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1803558853',display_name='tempest-AttachVolumeNegativeTest-server-1803558853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1803558853',id=22,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEj1nb6XRe42eVQ/cQa9EOnwxurjF6XOmzM+yCWgKrgOZr3fXRiUdUJIQSeBwGLLTgNMXpebmrgGsQV/QkLjRTN1NWcVg5fTBIqcXPwcTJyBnKB00Zy/24MDOUf5LZoXQ==',key_name='tempest-keypair-1060394141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-0bpc6ezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:15:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=72306b76-6bec-433a-ac37-e28218c3a265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:17:05,bridge_name='br-int',has_traffic_filtering=True,id=e2872a8e-ef72-45a5-a1b1-7221021badc4,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2872a8e-ef') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.objects.instance [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'pci_devices' on Instance uuid 72306b76-6bec-433a-ac37-e28218c3a265 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:15:05 user nova-compute[75205]:   <uuid>72306b76-6bec-433a-ac37-e28218c3a265</uuid>
Nov 14 19:15:05 user nova-compute[75205]:   <name>instance-00000016</name>
Nov 14 19:15:05 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:15:05 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:15:05 user nova-compute[75205]:   <metadata>
Nov 14 19:15:05 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:15:05 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:15:05 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1803558853</nova:name>
Nov 14 19:15:05 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:15:05</nova:creationTime>
Nov 14 19:15:05 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:15:05 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:15:05 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:15:05 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:15:05 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:15:05 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:15:05 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:15:05 user nova-compute[75205]:       <nova:owner>
Nov 14 19:15:05 user nova-compute[75205]:         <nova:user uuid="792e949c53df4fe390f93c0118590bb6">tempest-AttachVolumeNegativeTest-1777396465-project-member</nova:user>
Nov 14 19:15:05 user nova-compute[75205]:         <nova:project uuid="d42501d5d4964f49b8fe62e9c9c2bd24">tempest-AttachVolumeNegativeTest-1777396465</nova:project>
Nov 14 19:15:05 user nova-compute[75205]:       </nova:owner>
Nov 14 19:15:05 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:15:05 user nova-compute[75205]:       <nova:ports>
Nov 14 19:15:05 user nova-compute[75205]:         <nova:port uuid="e2872a8e-ef72-45a5-a1b1-7221021badc4">
Nov 14 19:15:05 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 19:15:05 user nova-compute[75205]:         </nova:port>
Nov 14 19:15:05 user nova-compute[75205]:       </nova:ports>
Nov 14 19:15:05 user nova-compute[75205]:     </nova:instance>
Nov 14 19:15:05 user nova-compute[75205]:   </metadata>
Nov 14 19:15:05 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:15:05 user nova-compute[75205]:     <system>
Nov 14 19:15:05 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:15:05 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:15:05 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:15:05 user nova-compute[75205]:       <entry name="serial">72306b76-6bec-433a-ac37-e28218c3a265</entry>
Nov 14 19:15:05 user nova-compute[75205]:       <entry name="uuid">72306b76-6bec-433a-ac37-e28218c3a265</entry>
Nov 14 19:15:05 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:15:05 user nova-compute[75205]:     </system>
Nov 14 19:15:05 user nova-compute[75205]:   </sysinfo>
Nov 14 19:15:05 user nova-compute[75205]:   <os>
Nov 14 19:15:05 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:15:05 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:15:05 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:15:05 user nova-compute[75205]:   </os>
Nov 14 19:15:05 user nova-compute[75205]:   <features>
Nov 14 19:15:05 user nova-compute[75205]:     <acpi/>
Nov 14 19:15:05 user nova-compute[75205]:     <apic/>
Nov 14 19:15:05 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:15:05 user nova-compute[75205]:   </features>
Nov 14 19:15:05 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:15:05 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:15:05 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:15:05 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:15:05 user nova-compute[75205]:   </clock>
Nov 14 19:15:05 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:15:05 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:15:05 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:15:05 user nova-compute[75205]:   </cpu>
Nov 14 19:15:05 user nova-compute[75205]:   <devices>
Nov 14 19:15:05 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:15:05 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:15:05 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk"/>
Nov 14 19:15:05 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:15:05 user nova-compute[75205]:     </disk>
Nov 14 19:15:05 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:15:05 user nova-compute[75205]:       <mac address="fa:16:3e:85:17:05"/>
Nov 14 19:15:05 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:15:05 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:15:05 user nova-compute[75205]:       <target dev="tape2872a8e-ef"/>
Nov 14 19:15:05 user nova-compute[75205]:     </interface>
Nov 14 19:15:05 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:15:05 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/console.log" append="off"/>
Nov 14 19:15:05 user nova-compute[75205]:     </serial>
Nov 14 19:15:05 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:15:05 user nova-compute[75205]:     <video>
Nov 14 19:15:05 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:15:05 user nova-compute[75205]:     </video>
Nov 14 19:15:05 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:15:05 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:15:05 user nova-compute[75205]:     </rng>
Nov 14 19:15:05 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:15:05 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:15:05 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:15:05 user nova-compute[75205]:     </memballoon>
Nov 14 19:15:05 user nova-compute[75205]:   </devices>
Nov 14 19:15:05 user nova-compute[75205]: </domain>
Nov 14 19:15:05 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1803558853',display_name='tempest-AttachVolumeNegativeTest-server-1803558853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1803558853',id=22,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEj1nb6XRe42eVQ/cQa9EOnwxurjF6XOmzM+yCWgKrgOZr3fXRiUdUJIQSeBwGLLTgNMXpebmrgGsQV/QkLjRTN1NWcVg5fTBIqcXPwcTJyBnKB00Zy/24MDOUf5LZoXQ==',key_name='tempest-keypair-1060394141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-0bpc6ezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:15:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=72306b76-6bec-433a-ac37-e28218c3a265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:17:05,bridge_name='br-int',has_traffic_filtering=True,id=e2872a8e-ef72-45a5-a1b1-7221021badc4,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2872a8e-ef') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_vif [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:17:05,bridge_name='br-int',has_traffic_filtering=True,id=e2872a8e-ef72-45a5-a1b1-7221021badc4,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2872a8e-ef') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e432873-a69e-5970-9768-8199da043f84', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2872a8e-ef, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2872a8e-ef, col_values=(('qos', UUID('85589ac7-5a7e-42ec-b674-f306077e0250')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2872a8e-ef, col_values=(('external_ids', {'iface-id': 'e2872a8e-ef72-45a5-a1b1-7221021badc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:17:05', 'vm-uuid': '72306b76-6bec-433a-ac37-e28218c3a265'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:05 user nova-compute[75205]: INFO os_vif [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:17:05,bridge_name='br-int',has_traffic_filtering=True,id=e2872a8e-ef72-45a5-a1b1-7221021badc4,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2872a8e-ef')
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSmlFEbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:15:05 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:15:05 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:15:05 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No VIF found with MAC fa:16:3e:85:17:05, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31826ef-43ad-4fb1-a902-45a547d5118e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:15:05 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[37628cb0-be28-4cfd-ba64-df467d76be5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67] added
Nov 14 19:15:05 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca03b9e-a7cf-4d05-a8e7-3473fb0d43bc]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c379047a-2e8c-491b-802c-4a801967256c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSmlFEbs {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSmlFEbs" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5142c30e-e17c-4cf6-a452-c5aef5b7107f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YSmlFEbs'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3654ad0f-b23e-4b2d-87ee-6fab689d7bae]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2777dc-be2b-4ba9-9eac-77235a2c1f06]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:15:05 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:15:05 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:15:05 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:15:05 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce791c77-6e83-4d29-bd0f-3590f5160750]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67, portal: 172.16.0.220,3260]
Nov 14 19:15:05 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67, portal: 172.16.0.220,3260] successful.
Nov 14 19:15:05 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'flavor' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3224a71a-57c1-4163-b4fe-8b37eda75c82]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received event network-changed-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Refreshing instance network info cache due to event network-changed-e2872a8e-ef72-45a5-a1b1-7221021badc4. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] Acquiring lock "refresh_cache-72306b76-6bec-433a-ac37-e28218c3a265" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] Acquired lock "refresh_cache-72306b76-6bec-433a-ac37-e28218c3a265" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG nova.network.neutron [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Refreshing network info cache for port e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[579094b8-62e7-476c-9c94-1b4f99a682df]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:15:05 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:15:05 user nova-compute[75205]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 (non-flash)
Nov 14 19:15:05 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:15:05 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:15:05 user nova-compute[75205]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 (non-flash)
Nov 14 19:15:05 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0cdce37f-1229-4e13-bc1b-55d686f5c741 tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.049s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[18109a47-c59b-4b5b-ac51-aa989e1ab56c]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:15:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSmlFEbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.network.neutron [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Updated VIF entry in instance network info cache for port e2872a8e-ef72-45a5-a1b1-7221021badc4. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.network.neutron [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Updating instance_info_cache with network_info: [{"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] Releasing lock "refresh_cache-72306b76-6bec-433a-ac37-e28218c3a265" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:06 user nova-compute[75205]: WARNING nova.compute.manager [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:06 user nova-compute[75205]: WARNING nova.compute.manager [req-95f9d31a-d0b1-4bb1-839a-1fe87a6431b0 req-8d1afc74-679f-47f5-97d6-ea11b24663bc service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:15:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23631353031663738', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631353031663738', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lazy-loading 'flavor' on Instance uuid cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-63ede604-23ba-4de5-92ab-8eb6918dc437 req-6d328a2e-166c-4460-abd3-208e52ac4d9a service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-changed-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-63ede604-23ba-4de5-92ab-8eb6918dc437 req-6d328a2e-166c-4460-abd3-208e52ac4d9a service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Refreshing instance network info cache due to event network-changed-814f09b6-754e-4e78-947a-6a7c488019e0. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-63ede604-23ba-4de5-92ab-8eb6918dc437 req-6d328a2e-166c-4460-abd3-208e52ac4d9a service nova] Acquiring lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-63ede604-23ba-4de5-92ab-8eb6918dc437 req-6d328a2e-166c-4460-abd3-208e52ac4d9a service nova] Acquired lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.network.neutron [req-63ede604-23ba-4de5-92ab-8eb6918dc437 req-6d328a2e-166c-4460-abd3-208e52ac4d9a service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Refreshing network info cache for port 814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:15:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:15:06 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:15:06 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:15:06 user nova-compute[75205]:   <target dev="sdc" bus="scsi"/>
Nov 14 19:15:06 user nova-compute[75205]:   <serial>00ceac4f-4b21-4cde-b03c-2cb3929d3f67</serial>
Nov 14 19:15:06 user nova-compute[75205]:   <address type="drive" controller="0" unit="2"/>
Nov 14 19:15:06 user nova-compute[75205]: </disk>
Nov 14 19:15:06 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a545db10-d577-43b3-81a6-f8b2280e1907 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.network.neutron [req-63ede604-23ba-4de5-92ab-8eb6918dc437 req-6d328a2e-166c-4460-abd3-208e52ac4d9a service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updated VIF entry in instance network info cache for port 814f09b6-754e-4e78-947a-6a7c488019e0. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.network.neutron [req-63ede604-23ba-4de5-92ab-8eb6918dc437 req-6d328a2e-166c-4460-abd3-208e52ac4d9a service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating instance_info_cache with network_info: [{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-63ede604-23ba-4de5-92ab-8eb6918dc437 req-6d328a2e-166c-4460-abd3-208e52ac4d9a service nova] Releasing lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] No BDM found with device name sda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] No VIF found with MAC fa:16:3e:0a:79:8f, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received event network-vif-plugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] Acquiring lock "72306b76-6bec-433a-ac37-e28218c3a265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] Lock "72306b76-6bec-433a-ac37-e28218c3a265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] Lock "72306b76-6bec-433a-ac37-e28218c3a265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] No waiting events found dispatching network-vif-plugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:07 user nova-compute[75205]: WARNING nova.compute.manager [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received unexpected event network-vif-plugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 for instance with vm_state building and task_state spawning.
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received event network-vif-plugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] Acquiring lock "72306b76-6bec-433a-ac37-e28218c3a265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] Lock "72306b76-6bec-433a-ac37-e28218c3a265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] Lock "72306b76-6bec-433a-ac37-e28218c3a265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] No waiting events found dispatching network-vif-plugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:07 user nova-compute[75205]: WARNING nova.compute.manager [req-09575351-5a23-4347-9198-a916e127eeb7 req-60c9e462-6541-4617-a6f5-2a5f8eadc0c4 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received unexpected event network-vif-plugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 for instance with vm_state building and task_state spawning.
Nov 14 19:15:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9e359dee-6b1b-427e-8d8b-f930f810490a tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.510s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:08 user nova-compute[75205]: INFO nova.compute.manager [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Detaching volume 00ceac4f-4b21-4cde-b03c-2cb3929d3f67
Nov 14 19:15:08 user nova-compute[75205]: INFO nova.virt.block_device [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Attempting to driver detach volume 00ceac4f-4b21-4cde-b03c-2cb3929d3f67 from mountpoint /dev/sdc
Nov 14 19:15:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Attempting to detach device sdc from instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:15:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:15:08 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:15:08 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:15:08 user nova-compute[75205]:   <target dev="sdc" bus="scsi"/>
Nov 14 19:15:08 user nova-compute[75205]:   <serial>00ceac4f-4b21-4cde-b03c-2cb3929d3f67</serial>
Nov 14 19:15:08 user nova-compute[75205]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 19:15:08 user nova-compute[75205]: </disk>
Nov 14 19:15:08 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:15:08 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Successfully detached device sdc from instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c from the persistent domain config.
Nov 14 19:15:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:15:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:15:08 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:15:08 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:15:08 user nova-compute[75205]:   <target dev="sdc" bus="scsi"/>
Nov 14 19:15:08 user nova-compute[75205]:   <serial>00ceac4f-4b21-4cde-b03c-2cb3929d3f67</serial>
Nov 14 19:15:08 user nova-compute[75205]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 19:15:08 user nova-compute[75205]: </disk>
Nov 14 19:15:08 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:15:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:15:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:15:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:15:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Instance spawned successfully.
Nov 14 19:15:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:15:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:15:09 user nova-compute[75205]: INFO nova.compute.manager [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 14 19:15:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:15:09 user nova-compute[75205]: INFO nova.compute.manager [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Took 7.35 seconds to build instance.
Nov 14 19:15:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-97f82ba4-d9e6-4748-96ff-40b51cf297ba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.479s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-99ce2f2c-c018-4aa8-b9e1-13a4b30945a1 req-e0a96b44-82d2-43f2-9259-f2d27a36178a service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-changed-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-99ce2f2c-c018-4aa8-b9e1-13a4b30945a1 req-e0a96b44-82d2-43f2-9259-f2d27a36178a service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Refreshing instance network info cache due to event network-changed-d78d73b9-cc60-4324-b5e4-2dede8700c73. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-99ce2f2c-c018-4aa8-b9e1-13a4b30945a1 req-e0a96b44-82d2-43f2-9259-f2d27a36178a service nova] Acquiring lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-99ce2f2c-c018-4aa8-b9e1-13a4b30945a1 req-e0a96b44-82d2-43f2-9259-f2d27a36178a service nova] Acquired lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-99ce2f2c-c018-4aa8-b9e1-13a4b30945a1 req-e0a96b44-82d2-43f2-9259-f2d27a36178a service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Refreshing network info cache for port d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:21 user nova-compute[75205]: INFO nova.compute.manager [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Terminating instance
Nov 14 19:15:21 user nova-compute[75205]: DEBUG nova.compute.manager [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-99ce2f2c-c018-4aa8-b9e1-13a4b30945a1 req-e0a96b44-82d2-43f2-9259-f2d27a36178a service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updated VIF entry in instance network info cache for port d78d73b9-cc60-4324-b5e4-2dede8700c73. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-99ce2f2c-c018-4aa8-b9e1-13a4b30945a1 req-e0a96b44-82d2-43f2-9259-f2d27a36178a service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating instance_info_cache with network_info: [{"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-99ce2f2c-c018-4aa8-b9e1-13a4b30945a1 req-e0a96b44-82d2-43f2-9259-f2d27a36178a service nova] Releasing lock "refresh_cache-a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:15:22 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Instance destroyed successfully.
Nov 14 19:15:22 user nova-compute[75205]: DEBUG nova.objects.instance [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lazy-loading 'resources' on Instance uuid a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-12776011',display_name='tempest-TestShelveInstance-server-12776011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-12776011',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyH+B2L9vDS52XGIOFtQq8GpoMcT6XKkpN4qVH8KFroHuiUxYrcjFcY9smZubExjgKxjYqZYOi2P2yxFniSvEDm0BToHMxKwXbhhxdZEWS5bAjtVcp6fhFwddzwHUoFew==',key_name='tempest-TestShelveInstance-1819955855',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:13:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2b1f81e3e4a4ae3a9b7554997d170c1',ramdisk_id='',reservation_id='r-rm2y2t00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1961803319',owner_user_name='tempest-TestShelveInstance-1961803319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:13:44Z,user_data=None,user_id='07cd34c968a9444a95fd601767385cfe',uuid=a3f91cd5-9ad2-49a0-9b53-4df71c63ff29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converting VIF {"id": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "address": "fa:16:3e:9c:b5:45", "network": {"id": "9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72", "bridge": "br-int", "label": "tempest-TestShelveInstance-496577435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2b1f81e3e4a4ae3a9b7554997d170c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78d73b9-cc", "ovs_interfaceid": "d78d73b9-cc60-4324-b5e4-2dede8700c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_vif [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd78d73b9-cc, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f05cd6b-08de-4f14-b2b0-f9906a95fd17) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:15:22 user nova-compute[75205]: INFO os_vif [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b5:45,bridge_name='br-int',has_traffic_filtering=True,id=d78d73b9-cc60-4324-b5e4-2dede8700c73,network=Network(9dc3d1ba-8b0c-45ed-9651-5067c1f3ad72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78d73b9-cc')
Nov 14 19:15:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbIWepfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:15:22 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[489c7853-daa9-4128-9ecd-84906a53eb28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:15:22 user nova-compute[75205]: No targets found.
Nov 14 19:15:22 user nova-compute[75205]: iSNS:
Nov 14 19:15:22 user nova-compute[75205]: No targets found.
Nov 14 19:15:22 user nova-compute[75205]: STATIC:
Nov 14 19:15:22 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:15:22 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:15:22 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:15:22 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651
Nov 14 19:15:22 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:15:22 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:15:22 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67
Nov 14 19:15:22 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:15:22 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:15:22 user nova-compute[75205]: FIRMWARE:
Nov 14 19:15:22 user nova-compute[75205]: No targets found.
Nov 14 19:15:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:15:22 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:15:22 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae551bf8-1e06-4eba-ac7e-7f9d6a5c9268]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68db9e8-0b2f-4951-9f6e-e87a2d1f5036]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:15:22 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:15:22 user nova-compute[75205]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 (non-flash)
Nov 14 19:15:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:15:22 user nova-compute[75205]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 (non-flash)
Nov 14 19:15:22 user nova-compute[75205]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 (non-flash)
Nov 14 19:15:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7412de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35cd3ea-253c-494b-8b8b-6110218251c8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a64113-7d30-4fbf-9e14-485e8a6761bd]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[893607f1-bca4-4ce6-9554-f791e91561a5]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a885e5e-66ff-47ce-a3f5-8a8440cc38a4]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26634663734653131', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f759a113', '/dev/disk/by-id/scsi-1SCST_BIOf759a113-f4f74e11cd6fa20a') {{(pid=85714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b342d4d-e66c-4295-b77c-e0dd4b164147]: (4, None) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[67253794-bf01-425b-904c-cba9411c4540]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5bf895-5b60-4b9d-b5d8-0cc5f7641314]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260]
Nov 14 19:15:22 user nova-compute[75205]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651, portal: 172.16.0.220,3260] successful.
Nov 14 19:15:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfabcc69-245e-4604-b0f7-19a66c796651 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2228a9-15b3-46ab-bea0-36c5833b4454]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] <== disconnect_volume: return (318ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:15:22 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Deleting instance files /opt/stack/data/nova/instances/a3f91cd5-9ad2-49a0-9b53-4df71c63ff29_del
Nov 14 19:15:22 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Deletion of /opt/stack/data/nova/instances/a3f91cd5-9ad2-49a0-9b53-4df71c63ff29_del complete
Nov 14 19:15:22 user nova-compute[75205]: INFO nova.compute.manager [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 14 19:15:22 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:15:22 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:23 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Took 0.46 seconds to deallocate network for instance.
Nov 14 19:15:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-1730bbaa-1ff9-4bad-b47e-bca349c3a04d req-eb69683c-9381-4368-8d69-746ef72cb1cf service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-vif-deleted-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:23 user nova-compute[75205]: INFO nova.compute.manager [req-1730bbaa-1ff9-4bad-b47e-bca349c3a04d req-eb69683c-9381-4368-8d69-746ef72cb1cf service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Neutron deleted interface d78d73b9-cc60-4324-b5e4-2dede8700c73; detaching it from the instance and deleting it from the info cache
Nov 14 19:15:23 user nova-compute[75205]: DEBUG nova.network.neutron [req-1730bbaa-1ff9-4bad-b47e-bca349c3a04d req-eb69683c-9381-4368-8d69-746ef72cb1cf service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-1730bbaa-1ff9-4bad-b47e-bca349c3a04d req-eb69683c-9381-4368-8d69-746ef72cb1cf service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Detach interface failed, port_id=d78d73b9-cc60-4324-b5e4-2dede8700c73, reason: Instance a3f91cd5-9ad2-49a0-9b53-4df71c63ff29 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-vif-unplugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] No waiting events found dispatching network-vif-unplugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-vif-unplugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] Acquiring lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] No waiting events found dispatching network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:23 user nova-compute[75205]: WARNING nova.compute.manager [req-ae88a44d-81b3-46f1-82b3-1ddb492a59ed req-e7972e60-d650-498b-8e94-2c3dc6b1d444 service nova] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Received unexpected event network-vif-plugged-d78d73b9-cc60-4324-b5e4-2dede8700c73 for instance with vm_state active and task_state deleting.
Nov 14 19:15:24 user nova-compute[75205]: INFO nova.compute.manager [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Took 0.92 seconds to detach 1 volumes for instance.
Nov 14 19:15:24 user nova-compute[75205]: DEBUG nova.compute.manager [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] [instance: a3f91cd5-9ad2-49a0-9b53-4df71c63ff29] Deleting volume: bfabcc69-245e-4604-b0f7-19a66c796651 {{(pid=75205) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.293s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:24 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:15:24 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Deleted allocations for instance a3f91cd5-9ad2-49a0-9b53-4df71c63ff29
Nov 14 19:15:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-59ca4549-78a6-49e3-94f4-65f8c81e2a8e tempest-TestShelveInstance-1961803319 tempest-TestShelveInstance-1961803319-project-member] Lock "a3f91cd5-9ad2-49a0-9b53-4df71c63ff29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.419s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:15:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c is timed out.
Nov 14 19:15:29 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Successfully detached device sdc from instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c from the live domain config.
Nov 14 19:15:29 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:15:29 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7349MB free_disk=25.077381134033203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSmlFEbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:15:29 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f804af58-74ac-4d5f-8582-c3eb2eeeb859]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:15:29 user nova-compute[75205]: No targets found.
Nov 14 19:15:29 user nova-compute[75205]: iSNS:
Nov 14 19:15:29 user nova-compute[75205]: No targets found.
Nov 14 19:15:29 user nova-compute[75205]: STATIC:
Nov 14 19:15:29 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:15:29 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:15:29 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:15:29 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67
Nov 14 19:15:29 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:15:29 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:15:29 user nova-compute[75205]: FIRMWARE:
Nov 14 19:15:29 user nova-compute[75205]: No targets found.
Nov 14 19:15:29 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:15:29 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:15:29 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8c3538-6b3a-4a9a-bbc1-1b3137c93246]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e910c675-7f1f-4ddc-a075-c6680ba34f4d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:15:29 user nova-compute[75205]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 (non-flash)
Nov 14 19:15:29 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:15:29 user nova-compute[75205]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 (non-flash)
Nov 14 19:15:29 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7412e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67'): ({'sdd'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Removing single pathed devices sdd {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02725f1-1489-4941-99ea-bf670dba1fd2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01d64fe-73e8-482a-8860-f53503406485]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Flushing IO for device /dev/sdd {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a67d6c2-1184-4e5a-b01f-e67bc8c974af]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance c7744d82-c045-4602-9d7a-83f7d331a77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6864c442-8284-4dd8-8165-ff891e5d5175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 72306b76-6bec-433a-ac37-e28218c3a265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca0d4c-b76f-4de2-b035-68813f05a816]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[63071361-307d-4408-ba17-05c1d4271a24]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39aea25-4b36-43f0-bd6f-1aa0ff5be8e0]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67, portal: 172.16.0.220,3260]
Nov 14 19:15:29 user nova-compute[75205]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67, portal: 172.16.0.220,3260] successful.
Nov 14 19:15:29 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ceac4f-4b21-4cde-b03c-2cb3929d3f67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff73183-f1e5-4e53-9d8d-2af9339b8162]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] <== disconnect_volume: return (307ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:15:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lazy-loading 'flavor' on Instance uuid cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-aadc99a4-eae4-4684-800d-906986483ad8 tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.017s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:15:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:15:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:15:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:15:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:15:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:15:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6e3657fa-d795-4732-852a-158c68452387] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:15:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 6e3657fa-d795-4732-852a-158c68452387 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:31 user nova-compute[75205]: INFO nova.compute.manager [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Terminating instance
Nov 14 19:15:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updating instance_info_cache with network_info: [{"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-e11ad93d-10f4-4e51-885b-a509bab5394c req-fa246c71-8751-45d4-9974-4a5262a0e1c2 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received event network-vif-unplugged-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e11ad93d-10f4-4e51-885b-a509bab5394c req-fa246c71-8751-45d4-9974-4a5262a0e1c2 service nova] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e11ad93d-10f4-4e51-885b-a509bab5394c req-fa246c71-8751-45d4-9974-4a5262a0e1c2 service nova] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e11ad93d-10f4-4e51-885b-a509bab5394c req-fa246c71-8751-45d4-9974-4a5262a0e1c2 service nova] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-e11ad93d-10f4-4e51-885b-a509bab5394c req-fa246c71-8751-45d4-9974-4a5262a0e1c2 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] No waiting events found dispatching network-vif-unplugged-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-e11ad93d-10f4-4e51-885b-a509bab5394c req-fa246c71-8751-45d4-9974-4a5262a0e1c2 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received event network-vif-unplugged-38be7883-5d11-431e-8a4c-7d70b2839e88 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:15:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Instance destroyed successfully.
Nov 14 19:15:32 user nova-compute[75205]: DEBUG nova.objects.instance [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lazy-loading 'resources' on Instance uuid cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T19:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1959790396',display_name='tempest-AttachSCSIVolumeTestJSON-server-1959790396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1959790396',id=18,image_ref='20040111-72c4-4d5f-898b-8201eb2febdd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAsg8UJFTQgzDBdXFl09Kgbs3mOFM5tOlCMLdylclQUCofkSOYuUx+ETvwit7FYkMWjI0QmSd9QKdPbLbZybqF/h6CbpcT7zbLE7/6B3KjKgun9uTxo/NzgPd3bkTR+aA==',key_name='tempest-keypair-888737085',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:13:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6489560619f64a12987762b7b5fcfb2a',ramdisk_id='',reservation_id='r-oc3kqz8k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='20040111-72c4-4d5f-898b-8201eb2febdd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1705157206',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1705157206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='605afe1a09b546d386a7603cb312f6b0',uuid=cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Converting VIF {"id": "38be7883-5d11-431e-8a4c-7d70b2839e88", "address": "fa:16:3e:0a:79:8f", "network": {"id": "46ab4507-e45f-4763-bf0b-59c44d8b6dd9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-224319234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6489560619f64a12987762b7b5fcfb2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38be7883-5d", "ovs_interfaceid": "38be7883-5d11-431e-8a4c-7d70b2839e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:79:8f,bridge_name='br-int',has_traffic_filtering=True,id=38be7883-5d11-431e-8a4c-7d70b2839e88,network=Network(46ab4507-e45f-4763-bf0b-59c44d8b6dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38be7883-5d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG os_vif [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:79:8f,bridge_name='br-int',has_traffic_filtering=True,id=38be7883-5d11-431e-8a4c-7d70b2839e88,network=Network(46ab4507-e45f-4763-bf0b-59c44d8b6dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38be7883-5d') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38be7883-5d, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ad01cde-11f3-49f0-8683-4d8a4e319382) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:32 user nova-compute[75205]: INFO os_vif [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:79:8f,bridge_name='br-int',has_traffic_filtering=True,id=38be7883-5d11-431e-8a4c-7d70b2839e88,network=Network(46ab4507-e45f-4763-bf0b-59c44d8b6dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38be7883-5d')
Nov 14 19:15:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Deleting instance files /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c_del
Nov 14 19:15:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Deletion of /opt/stack/data/nova/instances/cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c_del complete
Nov 14 19:15:32 user nova-compute[75205]: INFO nova.compute.manager [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 14 19:15:32 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:15:32 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:33 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Took 0.89 seconds to deallocate network for instance.
Nov 14 19:15:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-76131a9d-347f-40a3-9212-cd698e95d161 req-c6f01232-24d8-45fd-b532-f17f6159a650 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received event network-vif-deleted-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:33 user nova-compute[75205]: INFO nova.compute.manager [req-76131a9d-347f-40a3-9212-cd698e95d161 req-c6f01232-24d8-45fd-b532-f17f6159a650 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Neutron deleted interface 38be7883-5d11-431e-8a4c-7d70b2839e88; detaching it from the instance and deleting it from the info cache
Nov 14 19:15:33 user nova-compute[75205]: DEBUG nova.network.neutron [req-76131a9d-347f-40a3-9212-cd698e95d161 req-c6f01232-24d8-45fd-b532-f17f6159a650 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-76131a9d-347f-40a3-9212-cd698e95d161 req-c6f01232-24d8-45fd-b532-f17f6159a650 service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Detach interface failed, port_id=38be7883-5d11-431e-8a4c-7d70b2839e88, reason: Instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-43d21e2c-8bdf-449e-b0cc-26bfff36509a req-6ca84e29-a1ba-4f6d-8b77-d00ae8516cad service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received event network-vif-plugged-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-43d21e2c-8bdf-449e-b0cc-26bfff36509a req-6ca84e29-a1ba-4f6d-8b77-d00ae8516cad service nova] Acquiring lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-43d21e2c-8bdf-449e-b0cc-26bfff36509a req-6ca84e29-a1ba-4f6d-8b77-d00ae8516cad service nova] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-43d21e2c-8bdf-449e-b0cc-26bfff36509a req-6ca84e29-a1ba-4f6d-8b77-d00ae8516cad service nova] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-43d21e2c-8bdf-449e-b0cc-26bfff36509a req-6ca84e29-a1ba-4f6d-8b77-d00ae8516cad service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] No waiting events found dispatching network-vif-plugged-38be7883-5d11-431e-8a4c-7d70b2839e88 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:33 user nova-compute[75205]: WARNING nova.compute.manager [req-43d21e2c-8bdf-449e-b0cc-26bfff36509a req-6ca84e29-a1ba-4f6d-8b77-d00ae8516cad service nova] [instance: cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c] Received unexpected event network-vif-plugged-38be7883-5d11-431e-8a4c-7d70b2839e88 for instance with vm_state deleted and task_state None.
Nov 14 19:15:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:33 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Deleted allocations for instance cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c
Nov 14 19:15:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d12c544-255b-4c5d-b336-a0cc6868835b tempest-AttachSCSIVolumeTestJSON-1705157206 tempest-AttachSCSIVolumeTestJSON-1705157206-project-member] Lock "cc7cbb66-f6d4-4f8e-8af0-6d9f4d44596c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:34 user nova-compute[75205]: INFO nova.compute.manager [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Terminating instance
Nov 14 19:15:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:15:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:35 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Instance destroyed successfully.
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lazy-loading 'resources' on Instance uuid 92c7bf54-2b89-4a52-ab91-5ece2bd48b73 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1676998227',display_name='tempest-ServerStableDeviceRescueTest-server-1676998227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1676998227',id=3,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMICd9+/orLPOsksqqlXHWvNgODZ4beOKu5xU3X7tWgZC7C97oMTnqzPjEA1MxOE12JNfb4DNQCXeLb4+/3grN8spf9YFebiUCphHxLaLozc5X8YRCA0KWPqw4Wn2b/wOw==',key_name='tempest-keypair-1396550108',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e772e661157e4c6e93e46e7dd9f42f0c',ramdisk_id='',reservation_id='r-d71nwys7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-660038347',owner_user_name='tempest-ServerStableDeviceRescueTest-660038347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49f6cbfae91a4b388f1430a3b7a2707c',uuid=92c7bf54-2b89-4a52-ab91-5ece2bd48b73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Converting VIF {"id": "531d9209-139e-4463-9116-04f04ddca88e", "address": "fa:16:3e:36:db:ab", "network": {"id": "3c910353-259e-4f46-87f3-f8e4aea096e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1603309477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e772e661157e4c6e93e46e7dd9f42f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531d9209-13", "ovs_interfaceid": "531d9209-139e-4463-9116-04f04ddca88e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:db:ab,bridge_name='br-int',has_traffic_filtering=True,id=531d9209-139e-4463-9116-04f04ddca88e,network=Network(3c910353-259e-4f46-87f3-f8e4aea096e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531d9209-13') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG os_vif [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:db:ab,bridge_name='br-int',has_traffic_filtering=True,id=531d9209-139e-4463-9116-04f04ddca88e,network=Network(3c910353-259e-4f46-87f3-f8e4aea096e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531d9209-13') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap531d9209-13, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4701d9d9-f231-47c6-bc4b-bc799f2a1d09) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:35 user nova-compute[75205]: INFO os_vif [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:db:ab,bridge_name='br-int',has_traffic_filtering=True,id=531d9209-139e-4463-9116-04f04ddca88e,network=Network(3c910353-259e-4f46-87f3-f8e4aea096e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531d9209-13')
Nov 14 19:15:35 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Deleting instance files /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73_del
Nov 14 19:15:35 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Deletion of /opt/stack/data/nova/instances/92c7bf54-2b89-4a52-ab91-5ece2bd48b73_del complete
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-unplugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-unplugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-unplugged-531d9209-139e-4463-9116-04f04ddca88e for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] Acquiring lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] No waiting events found dispatching network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:15:35 user nova-compute[75205]: WARNING nova.compute.manager [req-8ea5fd11-c6c6-40f0-808c-e1d9e9d20fe2 req-f9fd72e4-c6dd-482b-ad84-3ecd7e2eafea service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received unexpected event network-vif-plugged-531d9209-139e-4463-9116-04f04ddca88e for instance with vm_state active and task_state deleting.
Nov 14 19:15:35 user nova-compute[75205]: INFO nova.compute.manager [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 19:15:35 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:15:35 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:15:36 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:36 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Took 1.14 seconds to deallocate network for instance.
Nov 14 19:15:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:36 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:15:36 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:15:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:36 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Deleted allocations for instance 92c7bf54-2b89-4a52-ab91-5ece2bd48b73
Nov 14 19:15:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b2405acc-48ff-4654-a11f-416d399634bd tempest-ServerStableDeviceRescueTest-660038347 tempest-ServerStableDeviceRescueTest-660038347-project-member] Lock "92c7bf54-2b89-4a52-ab91-5ece2bd48b73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.698s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-ca60a6fe-9053-4fa0-aa5f-2eda2bc17b9b req-91eebdbd-0054-4902-8d1a-6118f5c85ab1 service nova] [instance: 92c7bf54-2b89-4a52-ab91-5ece2bd48b73] Received event network-vif-deleted-531d9209-139e-4463-9116-04f04ddca88e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-2f93f531-c2eb-4776-a14e-a365c49088a7 req-4fef9310-37a2-4da1-b867-57ab2ceabc93 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received event network-changed-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-2f93f531-c2eb-4776-a14e-a365c49088a7 req-4fef9310-37a2-4da1-b867-57ab2ceabc93 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Refreshing instance network info cache due to event network-changed-0343e201-fc35-440c-9347-c394b44e22f6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2f93f531-c2eb-4776-a14e-a365c49088a7 req-4fef9310-37a2-4da1-b867-57ab2ceabc93 service nova] Acquiring lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2f93f531-c2eb-4776-a14e-a365c49088a7 req-4fef9310-37a2-4da1-b867-57ab2ceabc93 service nova] Acquired lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG nova.network.neutron [req-2f93f531-c2eb-4776-a14e-a365c49088a7 req-4fef9310-37a2-4da1-b867-57ab2ceabc93 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Refreshing network info cache for port 0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG nova.network.neutron [req-2f93f531-c2eb-4776-a14e-a365c49088a7 req-4fef9310-37a2-4da1-b867-57ab2ceabc93 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updated VIF entry in instance network info cache for port 0343e201-fc35-440c-9347-c394b44e22f6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG nova.network.neutron [req-2f93f531-c2eb-4776-a14e-a365c49088a7 req-4fef9310-37a2-4da1-b867-57ab2ceabc93 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updating instance_info_cache with network_info: [{"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2f93f531-c2eb-4776-a14e-a365c49088a7 req-4fef9310-37a2-4da1-b867-57ab2ceabc93 service nova] Releasing lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG nova.objects.instance [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lazy-loading 'flavor' on Instance uuid 6864c442-8284-4dd8-8165-ff891e5d5175 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:15:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:15:56 user nova-compute[75205]: INFO nova.compute.manager [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Attaching volume 8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 to /dev/vdb
Nov 14 19:15:56 user nova-compute[75205]: DEBUG os_brick.utils [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2471a020-e347-4fc9-b6ad-c41d3dec66c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[04139565-d88e-4a84-a3b7-f0def81bf6f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e816cad3-ae26-47d5-922e-8ee18b5c6aed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec471b8b-eadd-4c57-9a6c-d20591a6fa50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:15:56 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:15:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f174380-fcfd-48e3-b23a-8c99b8c4501f]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG os_brick.utils [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updating existing volume attachment record: 39c4b8b1-3191-4c7a-a13b-95af2e9b9df0 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:15:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDIPHcVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:16:00 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:16:00 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:16:00 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbe8a6b-2471-4aa4-a6ed-1e14024e10c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:16:00 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9195a3-0ca7-434e-b64d-a045c13c4ea8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5] added
Nov 14 19:16:00 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34eb181-85fe-47dc-97fc-1ee741962145]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8658286-e5df-4d35-804d-ce7c8ea3bd82]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDIPHcVY {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDIPHcVY" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[878ed886-b36c-40ec-b8cb-8df945aa6202]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eDIPHcVY'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5f905b-f46b-4e71-8721-8758a5939ae7]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dbe4d0-2065-4153-aa2d-396aded18dd6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:16:00 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:16:00 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99b6b66-6438-44d6-ad8d-74619f973626]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5, portal: 172.16.0.220,3260]
Nov 14 19:16:00 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5, portal: 172.16.0.220,3260] successful.
Nov 14 19:16:00 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c57e0-ff2b-46f4-b282-832a19081a22]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[191fb22e-fdfb-4978-adc6-177f830d1194]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:16:00 user nova-compute[75205]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 (non-flash)
Nov 14 19:16:00 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:16:00 user nova-compute[75205]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 (non-flash)
Nov 14 19:16:00 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47298b8-ba33-4f05-9d53-5931c279576b]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:00 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:16:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:01 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:16:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDIPHcVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:16:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:16:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26230616365326261', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:16:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230616365326261', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:16:01 user nova-compute[75205]: DEBUG nova.objects.instance [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lazy-loading 'flavor' on Instance uuid 6864c442-8284-4dd8-8165-ff891e5d5175 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:16:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:16:01 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:16:01 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:16:01 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:16:01 user nova-compute[75205]:   <serial>8150aaa2-4c71-4d65-aa49-9f3812cfcaf5</serial>
Nov 14 19:16:01 user nova-compute[75205]: </disk>
Nov 14 19:16:01 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:16:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:16:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:16:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] No VIF found with MAC fa:16:3e:55:58:e5, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:16:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-80ab2ffe-55ea-4b7c-aae6-d2fdc9b6bcfc tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.445s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:05 user nova-compute[75205]: INFO nova.compute.manager [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Detaching volume 8150aaa2-4c71-4d65-aa49-9f3812cfcaf5
Nov 14 19:16:05 user nova-compute[75205]: INFO nova.virt.block_device [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Attempting to driver detach volume 8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 from mountpoint /dev/vdb
Nov 14 19:16:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Attempting to detach device vdb from instance 6864c442-8284-4dd8-8165-ff891e5d5175 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:16:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:16:05 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:16:05 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:16:05 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:16:05 user nova-compute[75205]:   <serial>8150aaa2-4c71-4d65-aa49-9f3812cfcaf5</serial>
Nov 14 19:16:05 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:16:05 user nova-compute[75205]: </disk>
Nov 14 19:16:05 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:16:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Successfully detached device vdb from instance 6864c442-8284-4dd8-8165-ff891e5d5175 from the persistent domain config.
Nov 14 19:16:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6864c442-8284-4dd8-8165-ff891e5d5175 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:16:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:16:05 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:16:05 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:16:05 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:16:05 user nova-compute[75205]:   <serial>8150aaa2-4c71-4d65-aa49-9f3812cfcaf5</serial>
Nov 14 19:16:05 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:16:05 user nova-compute[75205]: </disk>
Nov 14 19:16:05 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:16:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6864c442-8284-4dd8-8165-ff891e5d5175 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:16:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:16:19 user nova-compute[75205]: INFO nova.compute.claims [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Claim successful on node user
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:16:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.policy [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '724a5d9855d043079616992e2e038274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b31b366df34fb6a0353eb2226a3fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:16:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Creating image(s)
Nov 14 19:16:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "/opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "/opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk 1073741824" returned: 0 in 0.051s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Successfully created port: e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Cannot resize image /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Ensure instance console log exists: /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Successfully updated port: e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "refresh_cache-fa1515bc-fa72-467e-ae09-54908b54fafa" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquired lock "refresh_cache-fa1515bc-fa72-467e-ae09-54908b54fafa" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-6edc7ab8-48a0-4e0b-b089-1068266567bd req-3ddaae2d-c43b-436a-b1a3-3c1519be3865 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received event network-changed-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-6edc7ab8-48a0-4e0b-b089-1068266567bd req-3ddaae2d-c43b-436a-b1a3-3c1519be3865 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Refreshing instance network info cache due to event network-changed-e75f4677-5a08-457c-9625-1c200a6552c3. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6edc7ab8-48a0-4e0b-b089-1068266567bd req-3ddaae2d-c43b-436a-b1a3-3c1519be3865 service nova] Acquiring lock "refresh_cache-fa1515bc-fa72-467e-ae09-54908b54fafa" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Updating instance_info_cache with network_info: [{"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Releasing lock "refresh_cache-fa1515bc-fa72-467e-ae09-54908b54fafa" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Instance network_info: |[{"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6edc7ab8-48a0-4e0b-b089-1068266567bd req-3ddaae2d-c43b-436a-b1a3-3c1519be3865 service nova] Acquired lock "refresh_cache-fa1515bc-fa72-467e-ae09-54908b54fafa" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-6edc7ab8-48a0-4e0b-b089-1068266567bd req-3ddaae2d-c43b-436a-b1a3-3c1519be3865 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Refreshing network info cache for port e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Start _get_guest_xml network_info=[{"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:16:21 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:16:21 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-523020605',display_name='tempest-TestServerVolumeAttachmentScenario-server-523020605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-523020605',id=23,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPqMVLjpedCDntmjbPrQUX2NJm6Mt16va/HwHe87YWSbXJ+HVktHwxeZk0YPNy3qj/Mh4eMJZkKHrvizHgnlWHGL0uDY68T6XxaUjELblmiX0rWPMuTw5uR7U2Qn7C9Qg==',key_name='tempest-keypair-518937349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40b31b366df34fb6a0353eb2226a3fa4',ramdisk_id='',reservation_id='r-urik8j8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1448910620',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1448910620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='724a5d9855d043079616992e2e038274',uuid=fa1515bc-fa72-467e-ae09-54908b54fafa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Converting VIF {"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:60:ae,bridge_name='br-int',has_traffic_filtering=True,id=e75f4677-5a08-457c-9625-1c200a6552c3,network=Network(72409e0a-b604-4ba5-9e75-3a4659dacd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75f4677-5a') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lazy-loading 'pci_devices' on Instance uuid fa1515bc-fa72-467e-ae09-54908b54fafa {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:16:21 user nova-compute[75205]:   <uuid>fa1515bc-fa72-467e-ae09-54908b54fafa</uuid>
Nov 14 19:16:21 user nova-compute[75205]:   <name>instance-00000017</name>
Nov 14 19:16:21 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:16:21 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:16:21 user nova-compute[75205]:   <metadata>
Nov 14 19:16:21 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:16:21 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:16:21 user nova-compute[75205]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-523020605</nova:name>
Nov 14 19:16:21 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:16:21</nova:creationTime>
Nov 14 19:16:21 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:16:21 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:16:21 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:16:21 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:16:21 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:16:21 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:16:21 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:16:21 user nova-compute[75205]:       <nova:owner>
Nov 14 19:16:21 user nova-compute[75205]:         <nova:user uuid="724a5d9855d043079616992e2e038274">tempest-TestServerVolumeAttachmentScenario-1448910620-project-member</nova:user>
Nov 14 19:16:21 user nova-compute[75205]:         <nova:project uuid="40b31b366df34fb6a0353eb2226a3fa4">tempest-TestServerVolumeAttachmentScenario-1448910620</nova:project>
Nov 14 19:16:21 user nova-compute[75205]:       </nova:owner>
Nov 14 19:16:21 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:16:21 user nova-compute[75205]:       <nova:ports>
Nov 14 19:16:21 user nova-compute[75205]:         <nova:port uuid="e75f4677-5a08-457c-9625-1c200a6552c3">
Nov 14 19:16:21 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 19:16:21 user nova-compute[75205]:         </nova:port>
Nov 14 19:16:21 user nova-compute[75205]:       </nova:ports>
Nov 14 19:16:21 user nova-compute[75205]:     </nova:instance>
Nov 14 19:16:21 user nova-compute[75205]:   </metadata>
Nov 14 19:16:21 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:16:21 user nova-compute[75205]:     <system>
Nov 14 19:16:21 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:16:21 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:16:21 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:16:21 user nova-compute[75205]:       <entry name="serial">fa1515bc-fa72-467e-ae09-54908b54fafa</entry>
Nov 14 19:16:21 user nova-compute[75205]:       <entry name="uuid">fa1515bc-fa72-467e-ae09-54908b54fafa</entry>
Nov 14 19:16:21 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:16:21 user nova-compute[75205]:     </system>
Nov 14 19:16:21 user nova-compute[75205]:   </sysinfo>
Nov 14 19:16:21 user nova-compute[75205]:   <os>
Nov 14 19:16:21 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:16:21 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:16:21 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:16:21 user nova-compute[75205]:   </os>
Nov 14 19:16:21 user nova-compute[75205]:   <features>
Nov 14 19:16:21 user nova-compute[75205]:     <acpi/>
Nov 14 19:16:21 user nova-compute[75205]:     <apic/>
Nov 14 19:16:21 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:16:21 user nova-compute[75205]:   </features>
Nov 14 19:16:21 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:16:21 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:16:21 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:16:21 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:16:21 user nova-compute[75205]:   </clock>
Nov 14 19:16:21 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:16:21 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:16:21 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:16:21 user nova-compute[75205]:   </cpu>
Nov 14 19:16:21 user nova-compute[75205]:   <devices>
Nov 14 19:16:21 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:16:21 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:16:21 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk"/>
Nov 14 19:16:21 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:16:21 user nova-compute[75205]:     </disk>
Nov 14 19:16:21 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:16:21 user nova-compute[75205]:       <mac address="fa:16:3e:cd:60:ae"/>
Nov 14 19:16:21 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:16:21 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:16:21 user nova-compute[75205]:       <target dev="tape75f4677-5a"/>
Nov 14 19:16:21 user nova-compute[75205]:     </interface>
Nov 14 19:16:21 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:16:21 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/console.log" append="off"/>
Nov 14 19:16:21 user nova-compute[75205]:     </serial>
Nov 14 19:16:21 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:16:21 user nova-compute[75205]:     <video>
Nov 14 19:16:21 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:16:21 user nova-compute[75205]:     </video>
Nov 14 19:16:21 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:16:21 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:16:21 user nova-compute[75205]:     </rng>
Nov 14 19:16:21 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:16:21 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:16:21 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:16:21 user nova-compute[75205]:     </memballoon>
Nov 14 19:16:21 user nova-compute[75205]:   </devices>
Nov 14 19:16:21 user nova-compute[75205]: </domain>
Nov 14 19:16:21 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-523020605',display_name='tempest-TestServerVolumeAttachmentScenario-server-523020605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-523020605',id=23,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPqMVLjpedCDntmjbPrQUX2NJm6Mt16va/HwHe87YWSbXJ+HVktHwxeZk0YPNy3qj/Mh4eMJZkKHrvizHgnlWHGL0uDY68T6XxaUjELblmiX0rWPMuTw5uR7U2Qn7C9Qg==',key_name='tempest-keypair-518937349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40b31b366df34fb6a0353eb2226a3fa4',ramdisk_id='',reservation_id='r-urik8j8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1448910620',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1448910620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='724a5d9855d043079616992e2e038274',uuid=fa1515bc-fa72-467e-ae09-54908b54fafa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Converting VIF {"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:60:ae,bridge_name='br-int',has_traffic_filtering=True,id=e75f4677-5a08-457c-9625-1c200a6552c3,network=Network(72409e0a-b604-4ba5-9e75-3a4659dacd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75f4677-5a') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG os_vif [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:60:ae,bridge_name='br-int',has_traffic_filtering=True,id=e75f4677-5a08-457c-9625-1c200a6552c3,network=Network(72409e0a-b604-4ba5-9e75-3a4659dacd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75f4677-5a') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e187093f-1a64-5fba-93e7-09755a97c4a1', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape75f4677-5a, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape75f4677-5a, col_values=(('qos', UUID('cbf0fa59-0c9d-4c19-be51-e052745e17b6')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape75f4677-5a, col_values=(('external_ids', {'iface-id': 'e75f4677-5a08-457c-9625-1c200a6552c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:60:ae', 'vm-uuid': 'fa1515bc-fa72-467e-ae09-54908b54fafa'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:21 user nova-compute[75205]: INFO os_vif [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:60:ae,bridge_name='br-int',has_traffic_filtering=True,id=e75f4677-5a08-457c-9625-1c200a6552c3,network=Network(72409e0a-b604-4ba5-9e75-3a4659dacd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75f4677-5a')
Nov 14 19:16:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] No VIF found with MAC fa:16:3e:cd:60:ae, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-6edc7ab8-48a0-4e0b-b089-1068266567bd req-3ddaae2d-c43b-436a-b1a3-3c1519be3865 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Updated VIF entry in instance network info cache for port e75f4677-5a08-457c-9625-1c200a6552c3. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-6edc7ab8-48a0-4e0b-b089-1068266567bd req-3ddaae2d-c43b-436a-b1a3-3c1519be3865 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Updating instance_info_cache with network_info: [{"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6edc7ab8-48a0-4e0b-b089-1068266567bd req-3ddaae2d-c43b-436a-b1a3-3c1519be3865 service nova] Releasing lock "refresh_cache-fa1515bc-fa72-467e-ae09-54908b54fafa" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-ffbc5cb6-1cb8-43bb-bf50-0957658f90ea req-1da0477c-0da2-457c-8a2b-a31712a4e2c9 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received event network-vif-plugged-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ffbc5cb6-1cb8-43bb-bf50-0957658f90ea req-1da0477c-0da2-457c-8a2b-a31712a4e2c9 service nova] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ffbc5cb6-1cb8-43bb-bf50-0957658f90ea req-1da0477c-0da2-457c-8a2b-a31712a4e2c9 service nova] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ffbc5cb6-1cb8-43bb-bf50-0957658f90ea req-1da0477c-0da2-457c-8a2b-a31712a4e2c9 service nova] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-ffbc5cb6-1cb8-43bb-bf50-0957658f90ea req-1da0477c-0da2-457c-8a2b-a31712a4e2c9 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] No waiting events found dispatching network-vif-plugged-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:16:23 user nova-compute[75205]: WARNING nova.compute.manager [req-ffbc5cb6-1cb8-43bb-bf50-0957658f90ea req-1da0477c-0da2-457c-8a2b-a31712a4e2c9 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received unexpected event network-vif-plugged-e75f4677-5a08-457c-9625-1c200a6552c3 for instance with vm_state building and task_state spawning.
Nov 14 19:16:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:24 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:16:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:16:25 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Instance spawned successfully.
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb746bb8-ba71-46d2-9c03-d214b9e9afa5 req-0a41d38f-0790-47ec-a107-e52547c8cd75 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received event network-vif-plugged-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb746bb8-ba71-46d2-9c03-d214b9e9afa5 req-0a41d38f-0790-47ec-a107-e52547c8cd75 service nova] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb746bb8-ba71-46d2-9c03-d214b9e9afa5 req-0a41d38f-0790-47ec-a107-e52547c8cd75 service nova] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb746bb8-ba71-46d2-9c03-d214b9e9afa5 req-0a41d38f-0790-47ec-a107-e52547c8cd75 service nova] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb746bb8-ba71-46d2-9c03-d214b9e9afa5 req-0a41d38f-0790-47ec-a107-e52547c8cd75 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] No waiting events found dispatching network-vif-plugged-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:16:25 user nova-compute[75205]: WARNING nova.compute.manager [req-cb746bb8-ba71-46d2-9c03-d214b9e9afa5 req-0a41d38f-0790-47ec-a107-e52547c8cd75 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received unexpected event network-vif-plugged-e75f4677-5a08-457c-9625-1c200a6552c3 for instance with vm_state building and task_state spawning.
Nov 14 19:16:25 user nova-compute[75205]: INFO nova.compute.manager [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:16:25 user nova-compute[75205]: INFO nova.compute.manager [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Took 6.20 seconds to build instance.
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ebe8876-1fd8-4c7c-85b5-97e5d2032db6 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.301s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:16:25 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6864c442-8284-4dd8-8165-ff891e5d5175 is timed out.
Nov 14 19:16:25 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Successfully detached device vdb from instance 6864c442-8284-4dd8-8165-ff891e5d5175 from the live domain config.
Nov 14 19:16:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDIPHcVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:16:25 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d478621-c294-450a-b110-986ed89d1014]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:16:25 user nova-compute[75205]: No targets found.
Nov 14 19:16:25 user nova-compute[75205]: iSNS:
Nov 14 19:16:25 user nova-compute[75205]: No targets found.
Nov 14 19:16:25 user nova-compute[75205]: STATIC:
Nov 14 19:16:25 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:16:25 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:16:25 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:16:25 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5
Nov 14 19:16:25 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:16:25 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:16:25 user nova-compute[75205]: FIRMWARE:
Nov 14 19:16:25 user nova-compute[75205]: No targets found.
Nov 14 19:16:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:16:25 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:16:25 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0151ddae-3694-45aa-949a-fbd0a9713dd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd07785-f7a4-425d-9e3e-ef8f47b3dd85]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:16:25 user nova-compute[75205]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 (non-flash)
Nov 14 19:16:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:16:25 user nova-compute[75205]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 (non-flash)
Nov 14 19:16:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb94b39ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea1fc64-d065-40fa-9a19-aa0645367419]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bdb8a2-0f2b-4235-80c2-da4f0365ec4f]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:16:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f50a74-bea7-4caa-9ed5-a33333dcb730]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[504fac64-5efa-4281-b87c-218e589c4ad6]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c81086-5be3-42e1-8c78-644f864c1031]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4061461d-72c0-4b72-8dd1-15c5485a0b3c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5, portal: 172.16.0.220,3260]
Nov 14 19:16:26 user nova-compute[75205]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5, portal: 172.16.0.220,3260] successful.
Nov 14 19:16:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8150aaa2-4c71-4d65-aa49-9f3812cfcaf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0112eb-2cb1-4450-868c-0e222ecb3bab]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] <== disconnect_volume: return (312ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updating instance_info_cache with network_info: [{"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lazy-loading 'flavor' on Instance uuid 6864c442-8284-4dd8-8165-ff891e5d5175 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9cb2fce6-048e-4354-8ad1-4f5f52f83c4c tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:30 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:16:30 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:16:30 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7814MB free_disk=25.254798889160156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:16:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance c7744d82-c045-4602-9d7a-83f7d331a77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6864c442-8284-4dd8-8165-ff891e5d5175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 72306b76-6bec-433a-ac37-e28218c3a265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance fa1515bc-fa72-467e-ae09-54908b54fafa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:16:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:16:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:16:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:16:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:16:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d2dc6293-853a-4d75-83d3-511e5814e471" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:16:40 user nova-compute[75205]: INFO nova.compute.claims [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Claim successful on node user
Nov 14 19:16:40 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG nova.network.neutron [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:16:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:16:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:16:40 user nova-compute[75205]: DEBUG nova.policy [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06b3b7a0f2ae441f8cb1d50891fcab94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fe039dc34949509e4ad72cd9da3bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:16:40 user nova-compute[75205]: INFO nova.virt.block_device [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Booting with volume snapshot 797049db-972c-4bff-9867-0ab054867dee at /dev/vda
Nov 14 19:16:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Successfully created port: d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:16:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Successfully updated port: d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "refresh_cache-d2dc6293-853a-4d75-83d3-511e5814e471" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquired lock "refresh_cache-d2dc6293-853a-4d75-83d3-511e5814e471" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-92146125-8e0d-4b2b-8ad9-b788f04e16fc req-ac53085e-2b5c-4370-b53c-338fbe2fdbf2 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-changed-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-92146125-8e0d-4b2b-8ad9-b788f04e16fc req-ac53085e-2b5c-4370-b53c-338fbe2fdbf2 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Refreshing instance network info cache due to event network-changed-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-92146125-8e0d-4b2b-8ad9-b788f04e16fc req-ac53085e-2b5c-4370-b53c-338fbe2fdbf2 service nova] Acquiring lock "refresh_cache-d2dc6293-853a-4d75-83d3-511e5814e471" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Updating instance_info_cache with network_info: [{"id": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "address": "fa:16:3e:04:d3:a8", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c4b7f0-bb", "ovs_interfaceid": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Releasing lock "refresh_cache-d2dc6293-853a-4d75-83d3-511e5814e471" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Instance network_info: |[{"id": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "address": "fa:16:3e:04:d3:a8", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c4b7f0-bb", "ovs_interfaceid": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-92146125-8e0d-4b2b-8ad9-b788f04e16fc req-ac53085e-2b5c-4370-b53c-338fbe2fdbf2 service nova] Acquired lock "refresh_cache-d2dc6293-853a-4d75-83d3-511e5814e471" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-92146125-8e0d-4b2b-8ad9-b788f04e16fc req-ac53085e-2b5c-4370-b53c-338fbe2fdbf2 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Refreshing network info cache for port d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:16:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-92146125-8e0d-4b2b-8ad9-b788f04e16fc req-ac53085e-2b5c-4370-b53c-338fbe2fdbf2 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Updated VIF entry in instance network info cache for port d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:16:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-92146125-8e0d-4b2b-8ad9-b788f04e16fc req-ac53085e-2b5c-4370-b53c-338fbe2fdbf2 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Updating instance_info_cache with network_info: [{"id": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "address": "fa:16:3e:04:d3:a8", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c4b7f0-bb", "ovs_interfaceid": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-92146125-8e0d-4b2b-8ad9-b788f04e16fc req-ac53085e-2b5c-4370-b53c-338fbe2fdbf2 service nova] Releasing lock "refresh_cache-d2dc6293-853a-4d75-83d3-511e5814e471" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-adbe8a27-d266-4d71-843c-b708c5d4977e req-973e87a2-5f21-45f8-bdd8-ee89e0eced3e service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received event network-changed-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-adbe8a27-d266-4d71-843c-b708c5d4977e req-973e87a2-5f21-45f8-bdd8-ee89e0eced3e service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Refreshing instance network info cache due to event network-changed-b53ded48-7665-4249-884c-8c0938a57fa0. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:16:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-adbe8a27-d266-4d71-843c-b708c5d4977e req-973e87a2-5f21-45f8-bdd8-ee89e0eced3e service nova] Acquiring lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-adbe8a27-d266-4d71-843c-b708c5d4977e req-973e87a2-5f21-45f8-bdd8-ee89e0eced3e service nova] Acquired lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:45 user nova-compute[75205]: DEBUG nova.network.neutron [req-adbe8a27-d266-4d71-843c-b708c5d4977e req-973e87a2-5f21-45f8-bdd8-ee89e0eced3e service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Refreshing network info cache for port b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG nova.network.neutron [req-adbe8a27-d266-4d71-843c-b708c5d4977e req-973e87a2-5f21-45f8-bdd8-ee89e0eced3e service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updated VIF entry in instance network info cache for port b53ded48-7665-4249-884c-8c0938a57fa0. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG nova.network.neutron [req-adbe8a27-d266-4d71-843c-b708c5d4977e req-973e87a2-5f21-45f8-bdd8-ee89e0eced3e service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updating instance_info_cache with network_info: [{"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-adbe8a27-d266-4d71-843c-b708c5d4977e req-973e87a2-5f21-45f8-bdd8-ee89e0eced3e service nova] Releasing lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG os_brick.utils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[151fcf15-5a69-4b5e-83e0-2a154a2981aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a974b3b9-ff0b-4f0b-b1b3-70e4e744c35c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bacd2d-4ba6-4296-8361-5185a22cb56f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a8f2de-38d7-4d08-8b1d-a24e2d5f2e80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:16:46 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:16:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3bd3c7-241e-4c64-8081-3c41f9df82aa]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG os_brick.utils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:16:46 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Updating existing volume attachment record: 0ff044b8-ddb6-42c8-a2f5-458f1b28f8d8 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:16:51 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Creating image(s)
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Ensure instance console log exists: /opt/stack/data/nova/instances/d2dc6293-853a-4d75-83d3-511e5814e471/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Start _get_guest_xml network_info=[{"id": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "address": "fa:16:3e:04:d3:a8", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c4b7f0-bb", "ovs_interfaceid": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnaIHVqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2dc6293-853a-4d75-83d3-511e5814e471', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7', 'serial': 'd5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7'}, 'attachment_id': '0ff044b8-ddb6-42c8-a2f5-458f1b28f8d8', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:16:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:16:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnaIHVqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:16:51 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:16:51 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:16:51 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6731d4-2e46-4e38-9aed-2b80d53bbc8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:16:51 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9325164a-c6c1-4cbe-979a-0901ad585f0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7] added
Nov 14 19:16:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[949d8fcb-e794-496d-90aa-8f67f903c4fc]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[585a287e-a615-40ac-bc09-ece46fb176aa]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnaIHVqx {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnaIHVqx" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0097b648-c968-4db9-80ed-78f643326f15]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tnaIHVqx'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bd03e7-abc2-43d2-89a9-f7908c6e66f2]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd72fbf1-328c-47d8-8288-a12bf68f8917]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:16:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:16:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c2e83a-41e0-4149-a25f-3f09267ca322]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7, portal: 172.16.0.220,3260]
Nov 14 19:16:51 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7, portal: 172.16.0.220,3260] successful.
Nov 14 19:16:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03c2a72-9b12-4c16-b7fd-da6310c33361]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[171e69db-be33-43ca-bc7c-e8262c7f4948]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:16:51 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:16:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:16:51 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:16:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:16:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fa06f7-de18-4a68-9ef1-92c343ba04e7]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:16:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnaIHVqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:16:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:16:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:16:52 user nova-compute[75205]: INFO nova.compute.claims [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Claim successful on node user
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26431383535646465', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431383535646465', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1915365756',display_name='tempest-TestVolumeBootPattern-server-1915365756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1915365756',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-77rgxv9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:16:41Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=d2dc6293-853a-4d75-83d3-511e5814e471,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "address": "fa:16:3e:04:d3:a8", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c4b7f0-bb", "ovs_interfaceid": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "address": "fa:16:3e:04:d3:a8", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c4b7f0-bb", "ovs_interfaceid": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:a8,bridge_name='br-int',has_traffic_filtering=True,id=d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c4b7f0-bb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'pci_devices' on Instance uuid d2dc6293-853a-4d75-83d3-511e5814e471 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:16:53 user nova-compute[75205]:   <uuid>d2dc6293-853a-4d75-83d3-511e5814e471</uuid>
Nov 14 19:16:53 user nova-compute[75205]:   <name>instance-00000018</name>
Nov 14 19:16:53 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:16:53 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:16:53 user nova-compute[75205]:   <metadata>
Nov 14 19:16:53 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:16:53 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:16:53 user nova-compute[75205]:       <nova:name>tempest-TestVolumeBootPattern-server-1915365756</nova:name>
Nov 14 19:16:53 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:16:51</nova:creationTime>
Nov 14 19:16:53 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:16:53 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:16:53 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:16:53 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:16:53 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:16:53 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:16:53 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:16:53 user nova-compute[75205]:       <nova:owner>
Nov 14 19:16:53 user nova-compute[75205]:         <nova:user uuid="06b3b7a0f2ae441f8cb1d50891fcab94">tempest-TestVolumeBootPattern-397278786-project-member</nova:user>
Nov 14 19:16:53 user nova-compute[75205]:         <nova:project uuid="e2fe039dc34949509e4ad72cd9da3bf1">tempest-TestVolumeBootPattern-397278786</nova:project>
Nov 14 19:16:53 user nova-compute[75205]:       </nova:owner>
Nov 14 19:16:53 user nova-compute[75205]:       <nova:ports>
Nov 14 19:16:53 user nova-compute[75205]:         <nova:port uuid="d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1">
Nov 14 19:16:53 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:16:53 user nova-compute[75205]:         </nova:port>
Nov 14 19:16:53 user nova-compute[75205]:       </nova:ports>
Nov 14 19:16:53 user nova-compute[75205]:     </nova:instance>
Nov 14 19:16:53 user nova-compute[75205]:   </metadata>
Nov 14 19:16:53 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:16:53 user nova-compute[75205]:     <system>
Nov 14 19:16:53 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:16:53 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:16:53 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:16:53 user nova-compute[75205]:       <entry name="serial">d2dc6293-853a-4d75-83d3-511e5814e471</entry>
Nov 14 19:16:53 user nova-compute[75205]:       <entry name="uuid">d2dc6293-853a-4d75-83d3-511e5814e471</entry>
Nov 14 19:16:53 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:16:53 user nova-compute[75205]:     </system>
Nov 14 19:16:53 user nova-compute[75205]:   </sysinfo>
Nov 14 19:16:53 user nova-compute[75205]:   <os>
Nov 14 19:16:53 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:16:53 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:16:53 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:16:53 user nova-compute[75205]:   </os>
Nov 14 19:16:53 user nova-compute[75205]:   <features>
Nov 14 19:16:53 user nova-compute[75205]:     <acpi/>
Nov 14 19:16:53 user nova-compute[75205]:     <apic/>
Nov 14 19:16:53 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:16:53 user nova-compute[75205]:   </features>
Nov 14 19:16:53 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:16:53 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:16:53 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:16:53 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:16:53 user nova-compute[75205]:   </clock>
Nov 14 19:16:53 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:16:53 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:16:53 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:16:53 user nova-compute[75205]:   </cpu>
Nov 14 19:16:53 user nova-compute[75205]:   <devices>
Nov 14 19:16:53 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:16:53 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:16:53 user nova-compute[75205]:       <source dev="/dev/sdc"/>
Nov 14 19:16:53 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:16:53 user nova-compute[75205]:       <serial>d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7</serial>
Nov 14 19:16:53 user nova-compute[75205]:     </disk>
Nov 14 19:16:53 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:16:53 user nova-compute[75205]:       <mac address="fa:16:3e:04:d3:a8"/>
Nov 14 19:16:53 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:16:53 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:16:53 user nova-compute[75205]:       <target dev="tapd4c4b7f0-bb"/>
Nov 14 19:16:53 user nova-compute[75205]:     </interface>
Nov 14 19:16:53 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:16:53 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/d2dc6293-853a-4d75-83d3-511e5814e471/console.log" append="off"/>
Nov 14 19:16:53 user nova-compute[75205]:     </serial>
Nov 14 19:16:53 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:16:53 user nova-compute[75205]:     <video>
Nov 14 19:16:53 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:16:53 user nova-compute[75205]:     </video>
Nov 14 19:16:53 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:16:53 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:16:53 user nova-compute[75205]:     </rng>
Nov 14 19:16:53 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:16:53 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:16:53 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:16:53 user nova-compute[75205]:     </memballoon>
Nov 14 19:16:53 user nova-compute[75205]:   </devices>
Nov 14 19:16:53 user nova-compute[75205]: </domain>
Nov 14 19:16:53 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1915365756',display_name='tempest-TestVolumeBootPattern-server-1915365756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1915365756',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-77rgxv9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:16:41Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=d2dc6293-853a-4d75-83d3-511e5814e471,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "address": "fa:16:3e:04:d3:a8", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c4b7f0-bb", "ovs_interfaceid": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "address": "fa:16:3e:04:d3:a8", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c4b7f0-bb", "ovs_interfaceid": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:a8,bridge_name='br-int',has_traffic_filtering=True,id=d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c4b7f0-bb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG os_vif [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:a8,bridge_name='br-int',has_traffic_filtering=True,id=d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c4b7f0-bb') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fef6d0d7-3769-5a53-80cd-6989091e58e0', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4c4b7f0-bb, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4c4b7f0-bb, col_values=(('qos', UUID('d28dac0b-ada1-4729-8de6-458a1e051183')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4c4b7f0-bb, col_values=(('external_ids', {'iface-id': 'd4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:d3:a8', 'vm-uuid': 'd2dc6293-853a-4d75-83d3-511e5814e471'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:53 user nova-compute[75205]: INFO os_vif [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:a8,bridge_name='br-int',has_traffic_filtering=True,id=d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c4b7f0-bb')
Nov 14 19:16:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No VIF found with MAC fa:16:3e:04:d3:a8, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.policy [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1414e772c8ac4c4f8c648cf0a4b7c18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0118c1a2ce88447d8fe121787dc8aead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-f945f6ba-e036-4406-9b8b-fdb19cd0d5de req-edf63ffd-eac6-45d8-8012-96117cadfc67 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received event network-changed-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-f945f6ba-e036-4406-9b8b-fdb19cd0d5de req-edf63ffd-eac6-45d8-8012-96117cadfc67 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Refreshing instance network info cache due to event network-changed-e2872a8e-ef72-45a5-a1b1-7221021badc4. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f945f6ba-e036-4406-9b8b-fdb19cd0d5de req-edf63ffd-eac6-45d8-8012-96117cadfc67 service nova] Acquiring lock "refresh_cache-72306b76-6bec-433a-ac37-e28218c3a265" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f945f6ba-e036-4406-9b8b-fdb19cd0d5de req-edf63ffd-eac6-45d8-8012-96117cadfc67 service nova] Acquired lock "refresh_cache-72306b76-6bec-433a-ac37-e28218c3a265" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-f945f6ba-e036-4406-9b8b-fdb19cd0d5de req-edf63ffd-eac6-45d8-8012-96117cadfc67 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Refreshing network info cache for port e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:16:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Creating image(s)
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "/opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "/opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.211s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk 1073741824" returned: 0 in 0.053s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-f945f6ba-e036-4406-9b8b-fdb19cd0d5de req-edf63ffd-eac6-45d8-8012-96117cadfc67 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Updated VIF entry in instance network info cache for port e2872a8e-ef72-45a5-a1b1-7221021badc4. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.network.neutron [req-f945f6ba-e036-4406-9b8b-fdb19cd0d5de req-edf63ffd-eac6-45d8-8012-96117cadfc67 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Updating instance_info_cache with network_info: [{"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f945f6ba-e036-4406-9b8b-fdb19cd0d5de req-edf63ffd-eac6-45d8-8012-96117cadfc67 service nova] Releasing lock "refresh_cache-72306b76-6bec-433a-ac37-e28218c3a265" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:16:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "2a32bb26-deb4-407d-a9e9-31de887e0b38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Cannot resize image /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Ensure instance console log exists: /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:16:54 user nova-compute[75205]: INFO nova.compute.claims [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Claim successful on node user
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Successfully created port: a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:16:54 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.compute.manager [req-8643d3a2-7c28-43ee-9d98-5f3177c99bca req-7808dbe1-7f0a-4771-afaf-d3affbc5e8d1 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8643d3a2-7c28-43ee-9d98-5f3177c99bca req-7808dbe1-7f0a-4771-afaf-d3affbc5e8d1 service nova] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8643d3a2-7c28-43ee-9d98-5f3177c99bca req-7808dbe1-7f0a-4771-afaf-d3affbc5e8d1 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8643d3a2-7c28-43ee-9d98-5f3177c99bca req-7808dbe1-7f0a-4771-afaf-d3affbc5e8d1 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.compute.manager [req-8643d3a2-7c28-43ee-9d98-5f3177c99bca req-7808dbe1-7f0a-4771-afaf-d3affbc5e8d1 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] No waiting events found dispatching network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:16:54 user nova-compute[75205]: WARNING nova.compute.manager [req-8643d3a2-7c28-43ee-9d98-5f3177c99bca req-7808dbe1-7f0a-4771-afaf-d3affbc5e8d1 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received unexpected event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 for instance with vm_state building and task_state spawning.
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "72306b76-6bec-433a-ac37-e28218c3a265" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.objects.instance [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'flavor' on Instance uuid 72306b76-6bec-433a-ac37-e28218c3a265 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.policy [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0ee9d2093e64175b45b3b4d99b5648f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde587867310451cab4f464b330555af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:16:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Creating image(s)
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "/opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "/opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "72306b76-6bec-433a-ac37-e28218c3a265" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:55 user nova-compute[75205]: INFO nova.compute.manager [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Attaching volume 3a6094f5-7227-4b36-bb01-cce95aa4eb01 to /dev/vdb
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Successfully updated port: a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "refresh_cache-3c53f075-6a96-4961-a89f-a5afffe1711f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquired lock "refresh_cache-3c53f075-6a96-4961-a89f-a5afffe1711f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG os_brick.utils [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c749f0b-f687-4caf-bd54-a2e3fd4b54d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.199s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0705cce-3af3-421b-b9c0-4e4977190607]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4183b9-04c9-4bdb-98e0-a5f278decedd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8921b14-070c-4801-8fb2-9fbaabd96788]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:16:55 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fa42c9-0e57-4f44-a0f5-982126db965e]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG os_brick.utils [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Updating existing volume attachment record: 27541a12-d3ed-4467-84c8-904b79643304 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.220s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk 1073741824" returned: 0 in 0.068s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Successfully created port: 527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Updating instance_info_cache with network_info: [{"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Releasing lock "refresh_cache-3c53f075-6a96-4961-a89f-a5afffe1711f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Instance network_info: |[{"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Start _get_guest_xml network_info=[{"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:16:55 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:16:55 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1799921118',display_name='tempest-TestVolumeSwap-server-1799921118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1799921118',id=25,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7B8MQNjXPa/nDtbI5vDgmTMEtY7WHT4g4k5DJT6EBNYje0rfviySVQDlBRIANnMI74Cv+r9WEOMjkIs2ZFWAbWMgrMOwJOzSMUxMjqCmTmvxfAuMDSJg5afRVgcktSoA==',key_name='tempest-keypair-805392591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0118c1a2ce88447d8fe121787dc8aead',ramdisk_id='',reservation_id='r-ty1mpo5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-999383946',owner_user_name='tempest-TestVolumeSwap-999383946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1414e772c8ac4c4f8c648cf0a4b7c18d',uuid=3c53f075-6a96-4961-a89f-a5afffe1711f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Converting VIF {"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a1c75ae0-844b-4b14-a4d8-77f116a65a6c,network=Network(b303a978-bb22-4748-9f4c-745d0ea30639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c75ae0-84') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.objects.instance [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c53f075-6a96-4961-a89f-a5afffe1711f {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.248s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:16:55 user nova-compute[75205]:   <uuid>3c53f075-6a96-4961-a89f-a5afffe1711f</uuid>
Nov 14 19:16:55 user nova-compute[75205]:   <name>instance-00000019</name>
Nov 14 19:16:55 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:16:55 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:16:55 user nova-compute[75205]:   <metadata>
Nov 14 19:16:55 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:16:55 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:16:55 user nova-compute[75205]:       <nova:name>tempest-TestVolumeSwap-server-1799921118</nova:name>
Nov 14 19:16:55 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:16:55</nova:creationTime>
Nov 14 19:16:55 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:16:55 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:16:55 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:16:55 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:16:55 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:16:55 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:16:55 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:16:55 user nova-compute[75205]:       <nova:owner>
Nov 14 19:16:55 user nova-compute[75205]:         <nova:user uuid="1414e772c8ac4c4f8c648cf0a4b7c18d">tempest-TestVolumeSwap-999383946-project-member</nova:user>
Nov 14 19:16:55 user nova-compute[75205]:         <nova:project uuid="0118c1a2ce88447d8fe121787dc8aead">tempest-TestVolumeSwap-999383946</nova:project>
Nov 14 19:16:55 user nova-compute[75205]:       </nova:owner>
Nov 14 19:16:55 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:16:55 user nova-compute[75205]:       <nova:ports>
Nov 14 19:16:55 user nova-compute[75205]:         <nova:port uuid="a1c75ae0-844b-4b14-a4d8-77f116a65a6c">
Nov 14 19:16:55 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 19:16:55 user nova-compute[75205]:         </nova:port>
Nov 14 19:16:55 user nova-compute[75205]:       </nova:ports>
Nov 14 19:16:55 user nova-compute[75205]:     </nova:instance>
Nov 14 19:16:55 user nova-compute[75205]:   </metadata>
Nov 14 19:16:55 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:16:55 user nova-compute[75205]:     <system>
Nov 14 19:16:55 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:16:55 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:16:55 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:16:55 user nova-compute[75205]:       <entry name="serial">3c53f075-6a96-4961-a89f-a5afffe1711f</entry>
Nov 14 19:16:55 user nova-compute[75205]:       <entry name="uuid">3c53f075-6a96-4961-a89f-a5afffe1711f</entry>
Nov 14 19:16:55 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:16:55 user nova-compute[75205]:     </system>
Nov 14 19:16:55 user nova-compute[75205]:   </sysinfo>
Nov 14 19:16:55 user nova-compute[75205]:   <os>
Nov 14 19:16:55 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:16:55 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:16:55 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:16:55 user nova-compute[75205]:   </os>
Nov 14 19:16:55 user nova-compute[75205]:   <features>
Nov 14 19:16:55 user nova-compute[75205]:     <acpi/>
Nov 14 19:16:55 user nova-compute[75205]:     <apic/>
Nov 14 19:16:55 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:16:55 user nova-compute[75205]:   </features>
Nov 14 19:16:55 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:16:55 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:16:55 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:16:55 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:16:55 user nova-compute[75205]:   </clock>
Nov 14 19:16:55 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:16:55 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:16:55 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:16:55 user nova-compute[75205]:   </cpu>
Nov 14 19:16:55 user nova-compute[75205]:   <devices>
Nov 14 19:16:55 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:16:55 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:16:55 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk"/>
Nov 14 19:16:55 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:16:55 user nova-compute[75205]:     </disk>
Nov 14 19:16:55 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:16:55 user nova-compute[75205]:       <mac address="fa:16:3e:7c:41:70"/>
Nov 14 19:16:55 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:16:55 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:16:55 user nova-compute[75205]:       <target dev="tapa1c75ae0-84"/>
Nov 14 19:16:55 user nova-compute[75205]:     </interface>
Nov 14 19:16:55 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:16:55 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/console.log" append="off"/>
Nov 14 19:16:55 user nova-compute[75205]:     </serial>
Nov 14 19:16:55 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:16:55 user nova-compute[75205]:     <video>
Nov 14 19:16:55 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:16:55 user nova-compute[75205]:     </video>
Nov 14 19:16:55 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:16:55 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:16:55 user nova-compute[75205]:     </rng>
Nov 14 19:16:55 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:16:55 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:16:55 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:16:55 user nova-compute[75205]:     </memballoon>
Nov 14 19:16:55 user nova-compute[75205]:   </devices>
Nov 14 19:16:55 user nova-compute[75205]: </domain>
Nov 14 19:16:55 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1799921118',display_name='tempest-TestVolumeSwap-server-1799921118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1799921118',id=25,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7B8MQNjXPa/nDtbI5vDgmTMEtY7WHT4g4k5DJT6EBNYje0rfviySVQDlBRIANnMI74Cv+r9WEOMjkIs2ZFWAbWMgrMOwJOzSMUxMjqCmTmvxfAuMDSJg5afRVgcktSoA==',key_name='tempest-keypair-805392591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0118c1a2ce88447d8fe121787dc8aead',ramdisk_id='',reservation_id='r-ty1mpo5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-999383946',owner_user_name='tempest-TestVolumeSwap-999383946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1414e772c8ac4c4f8c648cf0a4b7c18d',uuid=3c53f075-6a96-4961-a89f-a5afffe1711f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Converting VIF {"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a1c75ae0-844b-4b14-a4d8-77f116a65a6c,network=Network(b303a978-bb22-4748-9f4c-745d0ea30639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c75ae0-84') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG os_vif [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a1c75ae0-844b-4b14-a4d8-77f116a65a6c,network=Network(b303a978-bb22-4748-9f4c-745d0ea30639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c75ae0-84') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33c703de-9c0f-56d9-9d54-b8f1ad65a930', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1c75ae0-84, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1c75ae0-84, col_values=(('qos', UUID('389be9ab-c8a0-4793-92af-68db335a4f0e')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1c75ae0-84, col_values=(('external_ids', {'iface-id': 'a1c75ae0-844b-4b14-a4d8-77f116a65a6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:41:70', 'vm-uuid': '3c53f075-6a96-4961-a89f-a5afffe1711f'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:16:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:55 user nova-compute[75205]: INFO os_vif [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a1c75ae0-844b-4b14-a4d8-77f116a65a6c,network=Network(b303a978-bb22-4748-9f4c-745d0ea30639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c75ae0-84')
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] No VIF found with MAC fa:16:3e:7c:41:70, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Cannot resize image /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Ensure instance console log exists: /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Successfully updated port: 527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "refresh_cache-2a32bb26-deb4-407d-a9e9-31de887e0b38" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquired lock "refresh_cache-2a32bb26-deb4-407d-a9e9-31de887e0b38" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.compute.manager [req-ba216389-e5e5-4a88-84ab-2120e7db18aa req-5325f281-4b19-4893-ad74-b53a171a03b3 service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Received event network-changed-527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.compute.manager [req-ba216389-e5e5-4a88-84ab-2120e7db18aa req-5325f281-4b19-4893-ad74-b53a171a03b3 service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Refreshing instance network info cache due to event network-changed-527e37cf-145a-4e81-8849-0cba4a6d585b. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ba216389-e5e5-4a88-84ab-2120e7db18aa req-5325f281-4b19-4893-ad74-b53a171a03b3 service nova] Acquiring lock "refresh_cache-2a32bb26-deb4-407d-a9e9-31de887e0b38" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.compute.manager [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:16:56 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Instance spawned successfully.
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Updating instance_info_cache with network_info: [{"id": "527e37cf-145a-4e81-8849-0cba4a6d585b", "address": "fa:16:3e:99:7e:13", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap527e37cf-14", "ovs_interfaceid": "527e37cf-145a-4e81-8849-0cba4a6d585b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:56 user nova-compute[75205]: INFO nova.compute.manager [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 14 19:16:56 user nova-compute[75205]: DEBUG nova.compute.manager [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Releasing lock "refresh_cache-2a32bb26-deb4-407d-a9e9-31de887e0b38" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Instance network_info: |[{"id": "527e37cf-145a-4e81-8849-0cba4a6d585b", "address": "fa:16:3e:99:7e:13", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap527e37cf-14", "ovs_interfaceid": "527e37cf-145a-4e81-8849-0cba4a6d585b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ba216389-e5e5-4a88-84ab-2120e7db18aa req-5325f281-4b19-4893-ad74-b53a171a03b3 service nova] Acquired lock "refresh_cache-2a32bb26-deb4-407d-a9e9-31de887e0b38" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.network.neutron [req-ba216389-e5e5-4a88-84ab-2120e7db18aa req-5325f281-4b19-4893-ad74-b53a171a03b3 service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Refreshing network info cache for port 527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Start _get_guest_xml network_info=[{"id": "527e37cf-145a-4e81-8849-0cba4a6d585b", "address": "fa:16:3e:99:7e:13", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap527e37cf-14", "ovs_interfaceid": "527e37cf-145a-4e81-8849-0cba4a6d585b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received event network-changed-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Refreshing instance network info cache due to event network-changed-a1c75ae0-844b-4b14-a4d8-77f116a65a6c. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] Acquiring lock "refresh_cache-3c53f075-6a96-4961-a89f-a5afffe1711f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] Acquired lock "refresh_cache-3c53f075-6a96-4961-a89f-a5afffe1711f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.network.neutron [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Refreshing network info cache for port a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:16:57 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:16:57 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437001077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437001077',id=26,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-6xfmcr5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:16:55Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=2a32bb26-deb4-407d-a9e9-31de887e0b38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "527e37cf-145a-4e81-8849-0cba4a6d585b", "address": "fa:16:3e:99:7e:13", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap527e37cf-14", "ovs_interfaceid": "527e37cf-145a-4e81-8849-0cba4a6d585b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "527e37cf-145a-4e81-8849-0cba4a6d585b", "address": "fa:16:3e:99:7e:13", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap527e37cf-14", "ovs_interfaceid": "527e37cf-145a-4e81-8849-0cba4a6d585b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:7e:13,bridge_name='br-int',has_traffic_filtering=True,id=527e37cf-145a-4e81-8849-0cba4a6d585b,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap527e37cf-14') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a32bb26-deb4-407d-a9e9-31de887e0b38 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:16:57 user nova-compute[75205]: INFO nova.compute.manager [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Took 16.81 seconds to build instance.
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:16:57 user nova-compute[75205]:   <uuid>2a32bb26-deb4-407d-a9e9-31de887e0b38</uuid>
Nov 14 19:16:57 user nova-compute[75205]:   <name>instance-0000001a</name>
Nov 14 19:16:57 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:16:57 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:16:57 user nova-compute[75205]:   <metadata>
Nov 14 19:16:57 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:16:57 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:16:57 user nova-compute[75205]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-437001077</nova:name>
Nov 14 19:16:57 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:16:57</nova:creationTime>
Nov 14 19:16:57 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:16:57 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:16:57 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:16:57 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:16:57 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:16:57 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:16:57 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:16:57 user nova-compute[75205]:       <nova:owner>
Nov 14 19:16:57 user nova-compute[75205]:         <nova:user uuid="d0ee9d2093e64175b45b3b4d99b5648f">tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member</nova:user>
Nov 14 19:16:57 user nova-compute[75205]:         <nova:project uuid="fde587867310451cab4f464b330555af">tempest-ServerBootFromVolumeStableRescueTest-2146587572</nova:project>
Nov 14 19:16:57 user nova-compute[75205]:       </nova:owner>
Nov 14 19:16:57 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:16:57 user nova-compute[75205]:       <nova:ports>
Nov 14 19:16:57 user nova-compute[75205]:         <nova:port uuid="527e37cf-145a-4e81-8849-0cba4a6d585b">
Nov 14 19:16:57 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 19:16:57 user nova-compute[75205]:         </nova:port>
Nov 14 19:16:57 user nova-compute[75205]:       </nova:ports>
Nov 14 19:16:57 user nova-compute[75205]:     </nova:instance>
Nov 14 19:16:57 user nova-compute[75205]:   </metadata>
Nov 14 19:16:57 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:16:57 user nova-compute[75205]:     <system>
Nov 14 19:16:57 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:16:57 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:16:57 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:16:57 user nova-compute[75205]:       <entry name="serial">2a32bb26-deb4-407d-a9e9-31de887e0b38</entry>
Nov 14 19:16:57 user nova-compute[75205]:       <entry name="uuid">2a32bb26-deb4-407d-a9e9-31de887e0b38</entry>
Nov 14 19:16:57 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:16:57 user nova-compute[75205]:     </system>
Nov 14 19:16:57 user nova-compute[75205]:   </sysinfo>
Nov 14 19:16:57 user nova-compute[75205]:   <os>
Nov 14 19:16:57 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:16:57 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:16:57 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:16:57 user nova-compute[75205]:   </os>
Nov 14 19:16:57 user nova-compute[75205]:   <features>
Nov 14 19:16:57 user nova-compute[75205]:     <acpi/>
Nov 14 19:16:57 user nova-compute[75205]:     <apic/>
Nov 14 19:16:57 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:16:57 user nova-compute[75205]:   </features>
Nov 14 19:16:57 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:16:57 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:16:57 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:16:57 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:16:57 user nova-compute[75205]:   </clock>
Nov 14 19:16:57 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:16:57 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:16:57 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:16:57 user nova-compute[75205]:   </cpu>
Nov 14 19:16:57 user nova-compute[75205]:   <devices>
Nov 14 19:16:57 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:16:57 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:16:57 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk"/>
Nov 14 19:16:57 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:16:57 user nova-compute[75205]:     </disk>
Nov 14 19:16:57 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:16:57 user nova-compute[75205]:       <mac address="fa:16:3e:99:7e:13"/>
Nov 14 19:16:57 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:16:57 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:16:57 user nova-compute[75205]:       <target dev="tap527e37cf-14"/>
Nov 14 19:16:57 user nova-compute[75205]:     </interface>
Nov 14 19:16:57 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:16:57 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/console.log" append="off"/>
Nov 14 19:16:57 user nova-compute[75205]:     </serial>
Nov 14 19:16:57 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:16:57 user nova-compute[75205]:     <video>
Nov 14 19:16:57 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:16:57 user nova-compute[75205]:     </video>
Nov 14 19:16:57 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:16:57 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:16:57 user nova-compute[75205]:     </rng>
Nov 14 19:16:57 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:16:57 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:16:57 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:16:57 user nova-compute[75205]:     </memballoon>
Nov 14 19:16:57 user nova-compute[75205]:   </devices>
Nov 14 19:16:57 user nova-compute[75205]: </domain>
Nov 14 19:16:57 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437001077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437001077',id=26,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-6xfmcr5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:16:55Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=2a32bb26-deb4-407d-a9e9-31de887e0b38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "527e37cf-145a-4e81-8849-0cba4a6d585b", "address": "fa:16:3e:99:7e:13", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap527e37cf-14", "ovs_interfaceid": "527e37cf-145a-4e81-8849-0cba4a6d585b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "527e37cf-145a-4e81-8849-0cba4a6d585b", "address": "fa:16:3e:99:7e:13", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap527e37cf-14", "ovs_interfaceid": "527e37cf-145a-4e81-8849-0cba4a6d585b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:7e:13,bridge_name='br-int',has_traffic_filtering=True,id=527e37cf-145a-4e81-8849-0cba4a6d585b,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap527e37cf-14') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG os_vif [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:7e:13,bridge_name='br-int',has_traffic_filtering=True,id=527e37cf-145a-4e81-8849-0cba4a6d585b,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap527e37cf-14') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57e86de5-0d29-5dcb-a3ed-70142fadde71', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-acf04a31-7e01-428b-901a-466647e46a48 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d2dc6293-853a-4d75-83d3-511e5814e471" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.939s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap527e37cf-14, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap527e37cf-14, col_values=(('qos', UUID('8645bf56-5a8f-4b19-9cf7-6fd09bbe375e')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap527e37cf-14, col_values=(('external_ids', {'iface-id': '527e37cf-145a-4e81-8849-0cba4a6d585b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:7e:13', 'vm-uuid': '2a32bb26-deb4-407d-a9e9-31de887e0b38'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:57 user nova-compute[75205]: INFO os_vif [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:7e:13,bridge_name='br-int',has_traffic_filtering=True,id=527e37cf-145a-4e81-8849-0cba4a6d585b,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap527e37cf-14')
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No VIF found with MAC fa:16:3e:99:7e:13, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.network.neutron [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Updated VIF entry in instance network info cache for port a1c75ae0-844b-4b14-a4d8-77f116a65a6c. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.network.neutron [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Updating instance_info_cache with network_info: [{"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] Releasing lock "refresh_cache-3c53f075-6a96-4961-a89f-a5afffe1711f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] No waiting events found dispatching network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:16:57 user nova-compute[75205]: WARNING nova.compute.manager [req-2da73bb9-6031-42ad-9ab8-b0ad3e374aaf req-8f6933f4-3554-4a8c-b38b-078192748ed8 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received unexpected event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 for instance with vm_state building and task_state spawning.
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.network.neutron [req-ba216389-e5e5-4a88-84ab-2120e7db18aa req-5325f281-4b19-4893-ad74-b53a171a03b3 service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Updated VIF entry in instance network info cache for port 527e37cf-145a-4e81-8849-0cba4a6d585b. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG nova.network.neutron [req-ba216389-e5e5-4a88-84ab-2120e7db18aa req-5325f281-4b19-4893-ad74-b53a171a03b3 service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Updating instance_info_cache with network_info: [{"id": "527e37cf-145a-4e81-8849-0cba4a6d585b", "address": "fa:16:3e:99:7e:13", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap527e37cf-14", "ovs_interfaceid": "527e37cf-145a-4e81-8849-0cba4a6d585b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:16:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ba216389-e5e5-4a88-84ab-2120e7db18aa req-5325f281-4b19-4893-ad74-b53a171a03b3 service nova] Releasing lock "refresh_cache-2a32bb26-deb4-407d-a9e9-31de887e0b38" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:16:58 user nova-compute[75205]: INFO nova.compute.manager [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] instance snapshotting
Nov 14 19:16:58 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Beginning live snapshot process
Nov 14 19:16:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json -f qcow2 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received event network-vif-plugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] No waiting events found dispatching network-vif-plugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:16:58 user nova-compute[75205]: WARNING nova.compute.manager [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received unexpected event network-vif-plugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c for instance with vm_state building and task_state spawning.
Nov 14 19:16:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received event network-vif-plugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] No waiting events found dispatching network-vif-plugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:16:58 user nova-compute[75205]: WARNING nova.compute.manager [req-b6cd0eba-8d13-4faf-be63-87f678d7bd02 req-8f36c151-aec4-427d-8496-3bd9bac0b3ba service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received unexpected event network-vif-plugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c for instance with vm_state building and task_state spawning.
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json -f qcow2" returned: 0 in 0.252s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json -f qcow2 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.240s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1vo_b19r/db8cc2c1f51a4685b94ec8f907ed9303.delta 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:16:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1vo_b19r/db8cc2c1f51a4685b94ec8f907ed9303.delta 1073741824" returned: 0 in 0.061s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:16:59 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 19:16:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:16:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG nova.objects.instance [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lazy-loading 'flavor' on Instance uuid c7744d82-c045-4602-9d7a-83f7d331a77e {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.148s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:17:00 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:00 user nova-compute[75205]: INFO nova.compute.manager [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Attaching volume e61131b2-12a0-4593-85bd-155d9fcc8c96 to /dev/vdb
Nov 14 19:17:00 user nova-compute[75205]: DEBUG os_brick.utils [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1vo_b19r/db8cc2c1f51a4685b94ec8f907ed9303.delta /opt/stack/data/nova/instances/snapshots/tmp1vo_b19r/db8cc2c1f51a4685b94ec8f907ed9303 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5946f801-bff2-42c8-afcb-c8374758efa9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb365159-a5f3-4fb4-9fdc-c4811de2d04c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Received event network-vif-plugged-527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] Acquiring lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] No waiting events found dispatching network-vif-plugged-527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:00 user nova-compute[75205]: WARNING nova.compute.manager [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Received unexpected event network-vif-plugged-527e37cf-145a-4e81-8849-0cba4a6d585b for instance with vm_state building and task_state spawning.
Nov 14 19:17:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Received event network-vif-plugged-527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] Acquiring lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] No waiting events found dispatching network-vif-plugged-527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:00 user nova-compute[75205]: WARNING nova.compute.manager [req-89467802-08d4-41f7-ba6d-4b60c3c7d229 req-04e68ed5-8050-41e0-9022-bae6d29ba16d service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Received unexpected event network-vif-plugged-527e37cf-145a-4e81-8849-0cba4a6d585b for instance with vm_state building and task_state spawning.
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.181s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9ec7f8-956d-4ee3-8e9a-ef12f2f18d54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9b9b9f-a148-4462-8497-5069543673ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:17:00 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:17:00 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13a58b7-c37b-4514-b668-ce0d1cb6845f]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG os_brick.utils [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] <== get_connector_properties: return (379ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:17:00 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating existing volume attachment record: 0accb206-ea78-4b75-b975-a0fa3e4b776d {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1vo_b19r/db8cc2c1f51a4685b94ec8f907ed9303.delta /opt/stack/data/nova/instances/snapshots/tmp1vo_b19r/db8cc2c1f51a4685b94ec8f907ed9303" returned: 0 in 0.570s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Snapshot extracted, beginning image upload
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhdnATHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:17:01 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:17:01 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:17:01 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ac9db9-f690-4d1a-9c19-12bdfd808ca4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:17:01 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[930443f7-0b71-4351-baf7-c8cdac4393fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01] added
Nov 14 19:17:01 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca3f30b-9673-49ec-9df8-411e83c83e45]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ca678a-3c48-497c-9319-76fc2624b366]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhdnATHR {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhdnATHR" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e5c83d-e4ab-4fce-96e3-c5bffa315649]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NhdnATHR'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3817d87-6926-4659-ae2c-db99ccded8be]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdb964d-48fb-41bd-bc28-a0cfb1ef959f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:01 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:01 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:01 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:01 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[078965c6-0c40-44ca-b16f-460af016b486]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01, portal: 172.16.0.220,3260]
Nov 14 19:17:01 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01, portal: 172.16.0.220,3260] successful.
Nov 14 19:17:01 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06f1745-2c9b-4c50-8d7c-171b2f8fd698]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9c8a46-ecd2-4507-b5f9-991b3e60c5ed]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:01 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:01 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:01 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:01 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:01 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:01 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.038s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ac4f31-c011-4f5b-9044-60861349db69]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhdnATHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:17:01 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Instance spawned successfully.
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:01 user nova-compute[75205]: INFO nova.compute.manager [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Took 8.58 seconds to spawn the instance on the hypervisor.
Nov 14 19:17:01 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:17:01 user nova-compute[75205]: INFO nova.compute.manager [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Took 9.45 seconds to build instance.
Nov 14 19:17:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4e5b025e-8f23-4061-91d7-d64fc0c4a76e tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.573s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23639613932613635', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639613932613635', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.objects.instance [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'flavor' on Instance uuid 72306b76-6bec-433a-ac37-e28218c3a265 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:17:02 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:17:02 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:17:02 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:17:02 user nova-compute[75205]:   <serial>3a6094f5-7227-4b36-bb01-cce95aa4eb01</serial>
Nov 14 19:17:02 user nova-compute[75205]: </disk>
Nov 14 19:17:02 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:17:02 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Instance spawned successfully.
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:02 user nova-compute[75205]: INFO nova.compute.manager [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 14 19:17:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:17:03 user nova-compute[75205]: INFO nova.compute.manager [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Took 8.92 seconds to build instance.
Nov 14 19:17:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f70ec687-6658-424b-a84c-6fb68a5f7194 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.035s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:17:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:17:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No VIF found with MAC fa:16:3e:85:17:05, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:17:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-863d2dd7-ed74-4de9-b0de-504b26958362 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.232s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:04 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Snapshot image upload complete
Nov 14 19:17:04 user nova-compute[75205]: INFO nova.compute.manager [None req-8a31649b-a230-4b2c-9092-c37828672a5f tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Took 6.00 seconds to snapshot the instance on the hypervisor.
Nov 14 19:17:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "72306b76-6bec-433a-ac37-e28218c3a265" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:05 user nova-compute[75205]: INFO nova.compute.manager [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Detaching volume 3a6094f5-7227-4b36-bb01-cce95aa4eb01
Nov 14 19:17:05 user nova-compute[75205]: INFO nova.virt.block_device [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Attempting to driver detach volume 3a6094f5-7227-4b36-bb01-cce95aa4eb01 from mountpoint /dev/vdb
Nov 14 19:17:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Attempting to detach device vdb from instance 72306b76-6bec-433a-ac37-e28218c3a265 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:17:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:17:05 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:17:05 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:17:05 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:17:05 user nova-compute[75205]:   <serial>3a6094f5-7227-4b36-bb01-cce95aa4eb01</serial>
Nov 14 19:17:05 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:17:05 user nova-compute[75205]: </disk>
Nov 14 19:17:05 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:17:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully detached device vdb from instance 72306b76-6bec-433a-ac37-e28218c3a265 from the persistent domain config.
Nov 14 19:17:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72306b76-6bec-433a-ac37-e28218c3a265 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:17:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:17:05 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:17:05 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:17:05 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:17:05 user nova-compute[75205]:   <serial>3a6094f5-7227-4b36-bb01-cce95aa4eb01</serial>
Nov 14 19:17:05 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:17:05 user nova-compute[75205]: </disk>
Nov 14 19:17:05 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:17:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72306b76-6bec-433a-ac37-e28218c3a265 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "87a00d85-b082-4f6e-8869-987e01a91fa0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:06 user nova-compute[75205]: INFO nova.compute.manager [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Rescuing
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquired lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG nova.network.neutron [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG nova.compute.manager [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:17:06 user nova-compute[75205]: INFO nova.compute.claims [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Claim successful on node user
Nov 14 19:17:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:17:06 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:17:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:17:06 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:17:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:17:06 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c534490e-f6cb-4cd0-a584-a97618265ac3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:17:06 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf32b4ec-32e4-4651-8872-528437548731]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96] added
Nov 14 19:17:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[012a02bd-d945-4e51-84a1-4f514ee8a2d1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[74376cbe-0096-4f7a-8ac3-b29fc1e6de72]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpBCfcvL {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:06 user nova-compute[75205]: DEBUG nova.network.neutron [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Updating instance_info_cache with network_info: [{"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpBCfcvL" returned: 0 in 0.032s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4106d228-b65b-4f68-b286-1baad4b327d4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XpBCfcvL'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Releasing lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a085ec1-9b5e-4ead-b6f6-9e5f7c79627e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[016d6b6d-5b2d-453a-a2e5-8ee4861c1d37]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d4c560-6492-433e-9d8c-f6d50a84253e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]
Nov 14 19:17:07 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.
Nov 14 19:17:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[baefee0a-7d03-4ad3-acb1-11ae40ee7546]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76fc763-5e2c-4198-9d62-4457523cd70d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:17:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a2fcb-73c6-4e81-8555-a9999bbe9d20]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.705s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.network.neutron [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:17:07 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-3c93f867-5d12-4362-9c06-66295ad448d1 req-b1d6ac30-2ad3-4fc0-afc2-b334322bf2b8 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-unplugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3c93f867-5d12-4362-9c06-66295ad448d1 req-b1d6ac30-2ad3-4fc0-afc2-b334322bf2b8 service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3c93f867-5d12-4362-9c06-66295ad448d1 req-b1d6ac30-2ad3-4fc0-afc2-b334322bf2b8 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3c93f867-5d12-4362-9c06-66295ad448d1 req-b1d6ac30-2ad3-4fc0-afc2-b334322bf2b8 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-3c93f867-5d12-4362-9c06-66295ad448d1 req-b1d6ac30-2ad3-4fc0-afc2-b334322bf2b8 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-unplugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:07 user nova-compute[75205]: WARNING nova.compute.manager [req-3c93f867-5d12-4362-9c06-66295ad448d1 req-b1d6ac30-2ad3-4fc0-afc2-b334322bf2b8 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-unplugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state active and task_state rescuing.
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.policy [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67f99408d4954514aebc9d616ec5bcf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84244ff590a4bcaae6cc065b21cb12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:17:07 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Creating image(s)
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "/opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "/opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "/opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e.part --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.043s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] <== connect_volume: return (2048ms) {'type': 'block', 'scsi_wwn': '23233373137323234', 'path': '/dev/sde'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233373137323234', 'path': '/dev/sde'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG nova.network.neutron [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Successfully created port: 6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG nova.objects.instance [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lazy-loading 'flavor' on Instance uuid c7744d82-c045-4602-9d7a-83f7d331a77e {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:08 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Instance destroyed successfully.
Nov 14 19:17:08 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Attempting rescue
Nov 14 19:17:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75205) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:17:08 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:17:08 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:17:08 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:17:08 user nova-compute[75205]:   <serial>e61131b2-12a0-4593-85bd-155d9fcc8c96</serial>
Nov 14 19:17:08 user nova-compute[75205]: </disk>
Nov 14 19:17:08 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Instance directory exists: not creating {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 19:17:08 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Creating image(s)
Nov 14 19:17:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'trusted_certs' on Instance uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e.part --force-share --output=json" returned: 0 in 0.204s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.images [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] 5c500051-fe81-49c6-8792-8d8fff70418e was qcow2, converting to raw {{(pid=75205) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e.part /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e.converted {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.273s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue" returned: 0 in 0.082s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'migration_context' on Instance uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.objects.base [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<41394628-10e9-4adc-8bd5-0eae6cfe1f8a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Start _get_guest_xml network_info=[{"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "vif_mac": "fa:16:3e:fe:60:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'resources' on Instance uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.objects.base [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<41394628-10e9-4adc-8bd5-0eae6cfe1f8a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'numa_topology' on Instance uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e.part /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e.converted" returned: 0 in 0.336s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e.converted --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.objects.base [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<41394628-10e9-4adc-8bd5-0eae6cfe1f8a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:17:09 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:17:09 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'vcpu_model' on Instance uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.objects.base [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<41394628-10e9-4adc-8bd5-0eae6cfe1f8a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1510501547',display_name='tempest-ServerRescueNegativeTestJSON-server-1510501547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1510501547',id=16,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-rl9b6fr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:12:32Z,user_data=None,user_id='1b03af1014734b1a8d4c2633756070e8',uuid=41394628-10e9-4adc-8bd5-0eae6cfe1f8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "vif_mac": "fa:16:3e:fe:60:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "vif_mac": "fa:16:3e:fe:60:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=e2673078-5990-442a-ab11-60a51b39057e,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2673078-59') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'pci_devices' on Instance uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-5abbace2-25e4-4e08-b989-dc3ab1d94be1 req-25579f92-59b9-4e83-a4e6-0c64dde8bcc2 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5abbace2-25e4-4e08-b989-dc3ab1d94be1 req-25579f92-59b9-4e83-a4e6-0c64dde8bcc2 service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5abbace2-25e4-4e08-b989-dc3ab1d94be1 req-25579f92-59b9-4e83-a4e6-0c64dde8bcc2 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5abbace2-25e4-4e08-b989-dc3ab1d94be1 req-25579f92-59b9-4e83-a4e6-0c64dde8bcc2 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-5abbace2-25e4-4e08-b989-dc3ab1d94be1 req-25579f92-59b9-4e83-a4e6-0c64dde8bcc2 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:09 user nova-compute[75205]: WARNING nova.compute.manager [req-5abbace2-25e4-4e08-b989-dc3ab1d94be1 req-25579f92-59b9-4e83-a4e6-0c64dde8bcc2 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state active and task_state rescuing.
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] No VIF found with MAC fa:16:3e:c6:53:01, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.objects.base [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<41394628-10e9-4adc-8bd5-0eae6cfe1f8a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:17:09 user nova-compute[75205]:   <uuid>41394628-10e9-4adc-8bd5-0eae6cfe1f8a</uuid>
Nov 14 19:17:09 user nova-compute[75205]:   <name>instance-00000010</name>
Nov 14 19:17:09 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:17:09 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:17:09 user nova-compute[75205]:   <metadata>
Nov 14 19:17:09 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:17:09 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:17:09 user nova-compute[75205]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1510501547</nova:name>
Nov 14 19:17:09 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:17:09</nova:creationTime>
Nov 14 19:17:09 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:17:09 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:17:09 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:17:09 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:17:09 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:17:09 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:17:09 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:17:09 user nova-compute[75205]:       <nova:owner>
Nov 14 19:17:09 user nova-compute[75205]:         <nova:user uuid="1b03af1014734b1a8d4c2633756070e8">tempest-ServerRescueNegativeTestJSON-278369752-project-member</nova:user>
Nov 14 19:17:09 user nova-compute[75205]:         <nova:project uuid="7eabb88364cd4173ba71aa8920d40954">tempest-ServerRescueNegativeTestJSON-278369752</nova:project>
Nov 14 19:17:09 user nova-compute[75205]:       </nova:owner>
Nov 14 19:17:09 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:17:09 user nova-compute[75205]:       <nova:ports>
Nov 14 19:17:09 user nova-compute[75205]:         <nova:port uuid="e2673078-5990-442a-ab11-60a51b39057e">
Nov 14 19:17:09 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 19:17:09 user nova-compute[75205]:         </nova:port>
Nov 14 19:17:09 user nova-compute[75205]:       </nova:ports>
Nov 14 19:17:09 user nova-compute[75205]:     </nova:instance>
Nov 14 19:17:09 user nova-compute[75205]:   </metadata>
Nov 14 19:17:09 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:17:09 user nova-compute[75205]:     <system>
Nov 14 19:17:09 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:17:09 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:17:09 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:17:09 user nova-compute[75205]:       <entry name="serial">41394628-10e9-4adc-8bd5-0eae6cfe1f8a</entry>
Nov 14 19:17:09 user nova-compute[75205]:       <entry name="uuid">41394628-10e9-4adc-8bd5-0eae6cfe1f8a</entry>
Nov 14 19:17:09 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:17:09 user nova-compute[75205]:     </system>
Nov 14 19:17:09 user nova-compute[75205]:   </sysinfo>
Nov 14 19:17:09 user nova-compute[75205]:   <os>
Nov 14 19:17:09 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:17:09 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:17:09 user nova-compute[75205]:   </os>
Nov 14 19:17:09 user nova-compute[75205]:   <features>
Nov 14 19:17:09 user nova-compute[75205]:     <acpi/>
Nov 14 19:17:09 user nova-compute[75205]:     <apic/>
Nov 14 19:17:09 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:17:09 user nova-compute[75205]:   </features>
Nov 14 19:17:09 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:17:09 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:17:09 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:17:09 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:17:09 user nova-compute[75205]:   </clock>
Nov 14 19:17:09 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:17:09 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:17:09 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:17:09 user nova-compute[75205]:   </cpu>
Nov 14 19:17:09 user nova-compute[75205]:   <devices>
Nov 14 19:17:09 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:17:09 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:17:09 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue"/>
Nov 14 19:17:09 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:17:09 user nova-compute[75205]:     </disk>
Nov 14 19:17:09 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:17:09 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:17:09 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk"/>
Nov 14 19:17:09 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:17:09 user nova-compute[75205]:     </disk>
Nov 14 19:17:09 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:17:09 user nova-compute[75205]:       <mac address="fa:16:3e:fe:60:ed"/>
Nov 14 19:17:09 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:17:09 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:17:09 user nova-compute[75205]:       <target dev="tape2673078-59"/>
Nov 14 19:17:09 user nova-compute[75205]:     </interface>
Nov 14 19:17:09 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:17:09 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/console.log" append="off"/>
Nov 14 19:17:09 user nova-compute[75205]:     </serial>
Nov 14 19:17:09 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:17:09 user nova-compute[75205]:     <video>
Nov 14 19:17:09 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:17:09 user nova-compute[75205]:     </video>
Nov 14 19:17:09 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:17:09 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:17:09 user nova-compute[75205]:     </rng>
Nov 14 19:17:09 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:17:09 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:17:09 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:17:09 user nova-compute[75205]:     </memballoon>
Nov 14 19:17:09 user nova-compute[75205]:   </devices>
Nov 14 19:17:09 user nova-compute[75205]: </domain>
Nov 14 19:17:09 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:17:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Instance destroyed successfully.
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e.converted --force-share --output=json" returned: 0 in 0.229s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.030s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No VIF found with MAC fa:16:3e:fe:60:ed, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4b80ff1b-4c3c-4628-905e-79fbda9144da tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.307s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e --force-share --output=json" returned: 0 in 0.205s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e --force-share --output=json" returned: 0 in 0.220s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e,backing_fmt=raw /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Successfully updated port: 6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquired lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e,backing_fmt=raw /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk 1073741824" returned: 0 in 0.094s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-815988a3-8836-4a7b-b4e7-a6b41d2edfbf req-ab8710d6-3681-400f-bab6-9914f7a4a982 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received event network-changed-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-815988a3-8836-4a7b-b4e7-a6b41d2edfbf req-ab8710d6-3681-400f-bab6-9914f7a4a982 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Refreshing instance network info cache due to event network-changed-6252e873-ddb2-4609-8706-f08ef733e5e0. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-815988a3-8836-4a7b-b4e7-a6b41d2edfbf req-ab8710d6-3681-400f-bab6-9914f7a4a982 service nova] Acquiring lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e --force-share --output=json" returned: 0 in 0.199s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Ensure instance console log exists: /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Updating instance_info_cache with network_info: [{"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Releasing lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.compute.manager [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Instance network_info: |[{"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-815988a3-8836-4a7b-b4e7-a6b41d2edfbf req-ab8710d6-3681-400f-bab6-9914f7a4a982 service nova] Acquired lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.network.neutron [req-815988a3-8836-4a7b-b4e7-a6b41d2edfbf req-ab8710d6-3681-400f-bab6-9914f7a4a982 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Refreshing network info cache for port 6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Start _get_guest_xml network_info=[{"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2bf505c16b774d4353b4ac56a0ddb15f',container_format='bare',created_at=2023-11-14T19:16:58Z,direct_url=<?>,disk_format='qcow2',id=5c500051-fe81-49c6-8792-8d8fff70418e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-915604860',owner='b84244ff590a4bcaae6cc065b21cb12f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T19:17:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '5c500051-fe81-49c6-8792-8d8fff70418e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:17:10 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:17:10 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2bf505c16b774d4353b4ac56a0ddb15f',container_format='bare',created_at=2023-11-14T19:16:58Z,direct_url=<?>,disk_format='qcow2',id=5c500051-fe81-49c6-8792-8d8fff70418e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-915604860',owner='b84244ff590a4bcaae6cc065b21cb12f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T19:17:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1064691418',display_name='tempest-TestStampPattern-server-1064691418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1064691418',id=27,image_ref='5c500051-fe81-49c6-8792-8d8fff70418e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd1svgJTYybDPh1lPR3DIJKAtUs1FjktJwKG4A3pEzS7EJ21cmmx2eyxvLZzWkBvHvPEmdFTD/HrC2z/t88W02YyxzcpPr7NmabWOAd9mQhAqkZ+Jzq7r3Uf9KQEyTcwQ==',key_name='tempest-TestStampPattern-1251953881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84244ff590a4bcaae6cc065b21cb12f',ramdisk_id='',reservation_id='r-3pj9nwa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6864c442-8284-4dd8-8165-ff891e5d5175',image_min_disk='1',image_min_ram='0',image_owner_id='b84244ff590a4bcaae6cc065b21cb12f',image_owner_project_name='tempest-TestStampPattern-719339764',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-719339764-project-member',image_user_id='67f99408d4954514aebc9d616ec5bcf0',network_allocated='True',owner_project_name='tempest-TestStampPattern-719339764',owner_user_name='tempest-TestStampPattern-719339764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:17:07Z,user_data=None,user_id='67f99408d4954514aebc9d616ec5bcf0',uuid=87a00d85-b082-4f6e-8869-987e01a91fa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converting VIF {"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=6252e873-ddb2-4609-8706-f08ef733e5e0,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6252e873-dd') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.objects.instance [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lazy-loading 'pci_devices' on Instance uuid 87a00d85-b082-4f6e-8869-987e01a91fa0 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:17:10 user nova-compute[75205]:   <uuid>87a00d85-b082-4f6e-8869-987e01a91fa0</uuid>
Nov 14 19:17:10 user nova-compute[75205]:   <name>instance-0000001b</name>
Nov 14 19:17:10 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:17:10 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:17:10 user nova-compute[75205]:   <metadata>
Nov 14 19:17:10 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:17:10 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:17:10 user nova-compute[75205]:       <nova:name>tempest-TestStampPattern-server-1064691418</nova:name>
Nov 14 19:17:10 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:17:10</nova:creationTime>
Nov 14 19:17:10 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:17:10 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:17:10 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:17:10 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:17:10 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:17:10 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:17:10 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:17:10 user nova-compute[75205]:       <nova:owner>
Nov 14 19:17:10 user nova-compute[75205]:         <nova:user uuid="67f99408d4954514aebc9d616ec5bcf0">tempest-TestStampPattern-719339764-project-member</nova:user>
Nov 14 19:17:10 user nova-compute[75205]:         <nova:project uuid="b84244ff590a4bcaae6cc065b21cb12f">tempest-TestStampPattern-719339764</nova:project>
Nov 14 19:17:10 user nova-compute[75205]:       </nova:owner>
Nov 14 19:17:10 user nova-compute[75205]:       <nova:root type="image" uuid="5c500051-fe81-49c6-8792-8d8fff70418e"/>
Nov 14 19:17:10 user nova-compute[75205]:       <nova:ports>
Nov 14 19:17:10 user nova-compute[75205]:         <nova:port uuid="6252e873-ddb2-4609-8706-f08ef733e5e0">
Nov 14 19:17:10 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 19:17:10 user nova-compute[75205]:         </nova:port>
Nov 14 19:17:10 user nova-compute[75205]:       </nova:ports>
Nov 14 19:17:10 user nova-compute[75205]:     </nova:instance>
Nov 14 19:17:10 user nova-compute[75205]:   </metadata>
Nov 14 19:17:10 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:17:10 user nova-compute[75205]:     <system>
Nov 14 19:17:10 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:17:10 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:17:10 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:17:10 user nova-compute[75205]:       <entry name="serial">87a00d85-b082-4f6e-8869-987e01a91fa0</entry>
Nov 14 19:17:10 user nova-compute[75205]:       <entry name="uuid">87a00d85-b082-4f6e-8869-987e01a91fa0</entry>
Nov 14 19:17:10 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:17:10 user nova-compute[75205]:     </system>
Nov 14 19:17:10 user nova-compute[75205]:   </sysinfo>
Nov 14 19:17:10 user nova-compute[75205]:   <os>
Nov 14 19:17:10 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:17:10 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:17:10 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:17:10 user nova-compute[75205]:   </os>
Nov 14 19:17:10 user nova-compute[75205]:   <features>
Nov 14 19:17:10 user nova-compute[75205]:     <acpi/>
Nov 14 19:17:10 user nova-compute[75205]:     <apic/>
Nov 14 19:17:10 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:17:10 user nova-compute[75205]:   </features>
Nov 14 19:17:10 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:17:10 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:17:10 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:17:10 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:17:10 user nova-compute[75205]:   </clock>
Nov 14 19:17:10 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:17:10 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:17:10 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:17:10 user nova-compute[75205]:   </cpu>
Nov 14 19:17:10 user nova-compute[75205]:   <devices>
Nov 14 19:17:10 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:17:10 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:17:10 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk"/>
Nov 14 19:17:10 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:17:10 user nova-compute[75205]:     </disk>
Nov 14 19:17:10 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:17:10 user nova-compute[75205]:       <mac address="fa:16:3e:ce:a9:ef"/>
Nov 14 19:17:10 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:17:10 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:17:10 user nova-compute[75205]:       <target dev="tap6252e873-dd"/>
Nov 14 19:17:10 user nova-compute[75205]:     </interface>
Nov 14 19:17:10 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:17:10 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/console.log" append="off"/>
Nov 14 19:17:10 user nova-compute[75205]:     </serial>
Nov 14 19:17:10 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:17:10 user nova-compute[75205]:     <video>
Nov 14 19:17:10 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:17:10 user nova-compute[75205]:     </video>
Nov 14 19:17:10 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:17:10 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:17:10 user nova-compute[75205]:     </rng>
Nov 14 19:17:10 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:17:10 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:17:10 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:17:10 user nova-compute[75205]:     </memballoon>
Nov 14 19:17:10 user nova-compute[75205]:   </devices>
Nov 14 19:17:10 user nova-compute[75205]: </domain>
Nov 14 19:17:10 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1064691418',display_name='tempest-TestStampPattern-server-1064691418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1064691418',id=27,image_ref='5c500051-fe81-49c6-8792-8d8fff70418e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd1svgJTYybDPh1lPR3DIJKAtUs1FjktJwKG4A3pEzS7EJ21cmmx2eyxvLZzWkBvHvPEmdFTD/HrC2z/t88W02YyxzcpPr7NmabWOAd9mQhAqkZ+Jzq7r3Uf9KQEyTcwQ==',key_name='tempest-TestStampPattern-1251953881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84244ff590a4bcaae6cc065b21cb12f',ramdisk_id='',reservation_id='r-3pj9nwa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6864c442-8284-4dd8-8165-ff891e5d5175',image_min_disk='1',image_min_ram='0',image_owner_id='b84244ff590a4bcaae6cc065b21cb12f',image_owner_project_name='tempest-TestStampPattern-719339764',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-719339764-project-member',image_user_id='67f99408d4954514aebc9d616ec5bcf0',network_allocated='True',owner_project_name='tempest-TestStampPattern-719339764',owner_user_name='tempest-TestStampPattern-719339764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:17:07Z,user_data=None,user_id='67f99408d4954514aebc9d616ec5bcf0',uuid=87a00d85-b082-4f6e-8869-987e01a91fa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converting VIF {"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=6252e873-ddb2-4609-8706-f08ef733e5e0,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6252e873-dd') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG os_vif [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=6252e873-ddb2-4609-8706-f08ef733e5e0,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6252e873-dd') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '530e657d-894a-5b53-a355-51f74800f0cb', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6252e873-dd, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6252e873-dd, col_values=(('qos', UUID('86d2147d-d1e6-4f21-a4c4-9f76bc5ab067')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6252e873-dd, col_values=(('external_ids', {'iface-id': '6252e873-ddb2-4609-8706-f08ef733e5e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:a9:ef', 'vm-uuid': '87a00d85-b082-4f6e-8869-987e01a91fa0'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:10 user nova-compute[75205]: INFO os_vif [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=6252e873-ddb2-4609-8706-f08ef733e5e0,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6252e873-dd')
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:17:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] No VIF found with MAC fa:16:3e:ce:a9:ef, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG nova.network.neutron [req-815988a3-8836-4a7b-b4e7-a6b41d2edfbf req-ab8710d6-3681-400f-bab6-9914f7a4a982 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Updated VIF entry in instance network info cache for port 6252e873-ddb2-4609-8706-f08ef733e5e0. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG nova.network.neutron [req-815988a3-8836-4a7b-b4e7-a6b41d2edfbf req-ab8710d6-3681-400f-bab6-9914f7a4a982 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Updating instance_info_cache with network_info: [{"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-815988a3-8836-4a7b-b4e7-a6b41d2edfbf req-ab8710d6-3681-400f-bab6-9914f7a4a982 service nova] Releasing lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b4de3f16-6185-4649-b0e8-273e0130599e req-31cc49e8-1382-4655-9ff6-2378ece19dea service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b4de3f16-6185-4649-b0e8-273e0130599e req-31cc49e8-1382-4655-9ff6-2378ece19dea service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b4de3f16-6185-4649-b0e8-273e0130599e req-31cc49e8-1382-4655-9ff6-2378ece19dea service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b4de3f16-6185-4649-b0e8-273e0130599e req-31cc49e8-1382-4655-9ff6-2378ece19dea service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b4de3f16-6185-4649-b0e8-273e0130599e req-31cc49e8-1382-4655-9ff6-2378ece19dea service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:11 user nova-compute[75205]: WARNING nova.compute.manager [req-b4de3f16-6185-4649-b0e8-273e0130599e req-31cc49e8-1382-4655-9ff6-2378ece19dea service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state active and task_state rescuing.
Nov 14 19:17:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Stashing vm_state: active {{(pid=75205) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 19:17:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:12 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:17:12 user nova-compute[75205]: INFO nova.compute.claims [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Claim successful on node user
Nov 14 19:17:12 user nova-compute[75205]: INFO nova.compute.resource_tracker [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating resource usage from migration d363b2d7-52bb-47b9-8b0f-ac3acfabddeb
Nov 14 19:17:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:12 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:17:12 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.640s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:13 user nova-compute[75205]: INFO nova.compute.manager [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Migrating
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:17:13 user nova-compute[75205]: INFO nova.compute.rpcapi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquired lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating instance_info_cache with network_info: [{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Releasing lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:13 user nova-compute[75205]: WARNING nova.compute.manager [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state active and task_state rescuing.
Nov 14 19:17:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received event network-vif-plugged-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] Acquiring lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] No waiting events found dispatching network-vif-plugged-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:13 user nova-compute[75205]: WARNING nova.compute.manager [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received unexpected event network-vif-plugged-6252e873-ddb2-4609-8706-f08ef733e5e0 for instance with vm_state building and task_state spawning.
Nov 14 19:17:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received event network-vif-plugged-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] Acquiring lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] No waiting events found dispatching network-vif-plugged-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:13 user nova-compute[75205]: WARNING nova.compute.manager [req-463955f1-2a13-4901-b2fd-330505242575 req-da45fb6b-95ff-4303-9b56-0f83d861aa14 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received unexpected event network-vif-plugged-6252e873-ddb2-4609-8706-f08ef733e5e0 for instance with vm_state building and task_state spawning.
Nov 14 19:17:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Starting migrate_disk_and_power_off {{(pid=75205) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-6eb39adb-f7d6-4dc9-9ae4-1629f70f13f9 req-989bd636-2468-4a2b-b61c-8c7877b05ac3 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-unplugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6eb39adb-f7d6-4dc9-9ae4-1629f70f13f9 req-989bd636-2468-4a2b-b61c-8c7877b05ac3 service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6eb39adb-f7d6-4dc9-9ae4-1629f70f13f9 req-989bd636-2468-4a2b-b61c-8c7877b05ac3 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6eb39adb-f7d6-4dc9-9ae4-1629f70f13f9 req-989bd636-2468-4a2b-b61c-8c7877b05ac3 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-6eb39adb-f7d6-4dc9-9ae4-1629f70f13f9 req-989bd636-2468-4a2b-b61c-8c7877b05ac3 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-unplugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:14 user nova-compute[75205]: WARNING nova.compute.manager [req-6eb39adb-f7d6-4dc9-9ae4-1629f70f13f9 req-989bd636-2468-4a2b-b61c-8c7877b05ac3 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-unplugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state active and task_state resize_migrating.
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance destroyed successfully.
Nov 14 19:17:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1772840421',display_name='tempest-ServerActionsTestOtherB-server-1772840421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1772840421',id=19,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUvKLnxFaWKfqQ4S/vwP+KIMyYqWAdaytSw3dniXzUF4xEGN7HlZuv7hGHWqxL9ir7W3jD5e9NmeSnZ82sU02gBYwBF2DuOPl6Jkk6gX2AGI1xcTXp5bR0/Q/rxf2ub4A==',key_name='tempest-keypair-444037287',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41ef713467204951b8d5433d80805441',ramdisk_id='',reservation_id='r-5k36qfa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-938366899',owner_user_name='tempest-ServerActionsTestOtherB-938366899-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:17:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614f7aa49ee045c1a3cd9d23cb6bdebe',uuid=c7744d82-c045-4602-9d7a-83f7d331a77e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-862995617-network", "vif_mac": "fa:16:3e:c6:53:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converting VIF {"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-862995617-network", "vif_mac": "fa:16:3e:c6:53:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_vif [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap814f09b6-75, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cebade0-d661-47fc-9f67-2f9e10a277e7) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:14 user nova-compute[75205]: INFO os_vif [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75')
Nov 14 19:17:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:17:14 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41a7d0c-8a8d-401d-8fac-462c65ba59b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:17:14 user nova-compute[75205]: No targets found.
Nov 14 19:17:14 user nova-compute[75205]: iSNS:
Nov 14 19:17:14 user nova-compute[75205]: No targets found.
Nov 14 19:17:14 user nova-compute[75205]: STATIC:
Nov 14 19:17:14 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:17:14 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:17:14 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:17:14 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7
Nov 14 19:17:14 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:17:14 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:17:14 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01
Nov 14 19:17:14 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:17:14 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:17:14 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:17:14 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:17:14 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:17:14 user nova-compute[75205]: FIRMWARE:
Nov 14 19:17:14 user nova-compute[75205]: No targets found.
Nov 14 19:17:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:17:14 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:17:14 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f7b3cf-fa23-4bbc-94ac-52eab2b30c35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de07d82-a5fc-4fb6-962d-2d35c9244b8c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:14 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:14 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:14 user nova-compute[75205]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:17:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:14 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:14 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:14 user nova-compute[75205]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:17:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c27b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96'): ({'sde'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Removing single pathed devices sde {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2622cb-68e6-450e-843f-0723f9e64898]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[251154f7-f13e-419f-a257-bd6ccd825fe7]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Flushing IO for device /dev/sde {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abdcf7f-fe37-4e27-91a3-d3d8b03f7cf1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf97e4e-5b64-4d2b-b1d1-e9d3d7f860cf]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-cbf0891b-96ab-4f68-af42-aa339562fa42 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5148bd-e522-4160-b929-7852b6cd1887]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.112s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff297ae3-3010-4b9e-bb8d-17141636748c]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]
Nov 14 19:17:15 user nova-compute[75205]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.
Nov 14 19:17:15 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[beafeba7-f972-4d2b-9415-b95b5d2ead53]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] <== disconnect_volume: return (451ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:17:15 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Instance spawned successfully.
Nov 14 19:17:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e_resize/disk /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:15 user nova-compute[75205]: INFO nova.compute.manager [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Took 7.94 seconds to spawn the instance on the hypervisor.
Nov 14 19:17:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:17:15 user nova-compute[75205]: INFO nova.compute.manager [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Took 9.14 seconds to build instance.
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-df3191cb-9adf-47ac-8da5-cf7428f6fa02 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.271s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "cp -r /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e_resize/disk /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk" returned: 0 in 0.491s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e_resize/disk.info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk.info {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "cp -r /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e_resize/disk.info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk.info" returned: 0 in 0.036s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-e95140ef-d752-478a-8f63-e873968ab383 req-f24f6367-c2d7-474e-97f1-638feb5503b9 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e95140ef-d752-478a-8f63-e873968ab383 req-f24f6367-c2d7-474e-97f1-638feb5503b9 service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e95140ef-d752-478a-8f63-e873968ab383 req-f24f6367-c2d7-474e-97f1-638feb5503b9 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e95140ef-d752-478a-8f63-e873968ab383 req-f24f6367-c2d7-474e-97f1-638feb5503b9 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-e95140ef-d752-478a-8f63-e873968ab383 req-f24f6367-c2d7-474e-97f1-638feb5503b9 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:16 user nova-compute[75205]: WARNING nova.compute.manager [req-e95140ef-d752-478a-8f63-e873968ab383 req-f24f6367-c2d7-474e-97f1-638feb5503b9 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state active and task_state resize_migrating.
Nov 14 19:17:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Port 814f09b6-754e-4e78-947a-6a7c488019e0 binding to destination host user is already ACTIVE {{(pid=75205) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquired lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating instance_info_cache with network_info: [{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Releasing lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG os_brick.utils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:17:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e339bc3-dbaf-44d7-b2d2-abaa60e428a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28c8968-f920-4aaf-a9c1-f12481a480b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13eacff-ddd3-4bd9-abae-d58aaf81447d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aea3185-dde2-4995-ac24-870967bb2747]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:17:18 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:17:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eaaff2-f88b-4a06-90d3-f3aa9cfed035]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:17:18 user nova-compute[75205]: DEBUG os_brick.utils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:17:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Starting finish_migration {{(pid=75205) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance directory exists: not creating {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 19:17:23 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Creating image(s)
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk. size=21474836480 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk 21474836480 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk 21474836480" returned: 0 in 0.044s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Ensure instance console log exists: /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Start _get_guest_xml network_info=[{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-862995617-network", "vif_mac": "fa:16:3e:c6:53:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c7744d82-c045-4602-9d7a-83f7d331a77e', 'attached_at': '2023-11-14T19:17:23.000000', 'detached_at': '', 'volume_id': 'e61131b2-12a0-4593-85bd-155d9fcc8c96', 'serial': 'e61131b2-12a0-4593-85bd-155d9fcc8c96'}, 'attachment_id': '0f090efa-6a48-4efe-8859-aa691b042185', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:17:23 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:17:23 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:17:23 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:17:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:17:23 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:17:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:17:23 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fb71a7-0b43-4598-8ac0-e6b9eeac7e5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:17:23 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1348dc-d21f-42e4-a6c1-5fd4b44c5380]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96] added
Nov 14 19:17:23 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b9d65f-4717-450a-aa8d-40cbbf6c34ab]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ec103e-0190-4c52-b6d5-ba35a32d83f7]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpBCfcvL {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpBCfcvL" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82c0226-7d89-4af5-ad44-c345155d33a9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XpBCfcvL'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118ff92-bb6f-40bb-9e18-3c97b472a923]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[83266657-3c96-4ad4-9c07-2457d38abbf2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae6f450-d3d1-4f14-8611-ba8ae1d8073d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]
Nov 14 19:17:24 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.
Nov 14 19:17:24 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce025d23-2658-46c6-ba15-bd670c9b7390]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51916da-5587-4420-b4c7-7aeea6a3ea54]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:17:24 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bf59db-91b9-4eaa-9536-7b453a9e40b1]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:17:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23233373137323234', 'path': '/dev/sde'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233373137323234', 'path': '/dev/sde'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1772840421',display_name='tempest-ServerActionsTestOtherB-server-1772840421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1772840421',id=19,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUvKLnxFaWKfqQ4S/vwP+KIMyYqWAdaytSw3dniXzUF4xEGN7HlZuv7hGHWqxL9ir7W3jD5e9NmeSnZ82sU02gBYwBF2DuOPl6Jkk6gX2AGI1xcTXp5bR0/Q/rxf2ub4A==',key_name='tempest-keypair-444037287',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41ef713467204951b8d5433d80805441',ramdisk_id='',reservation_id='r-5k36qfa4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-938366899',owner_user_name='tempest-ServerActionsTestOtherB-938366899-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614f7aa49ee045c1a3cd9d23cb6bdebe',uuid=c7744d82-c045-4602-9d7a-83f7d331a77e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-862995617-network", "vif_mac": "fa:16:3e:c6:53:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converting VIF {"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-862995617-network", "vif_mac": "fa:16:3e:c6:53:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:17:25 user nova-compute[75205]:   <uuid>c7744d82-c045-4602-9d7a-83f7d331a77e</uuid>
Nov 14 19:17:25 user nova-compute[75205]:   <name>instance-00000013</name>
Nov 14 19:17:25 user nova-compute[75205]:   <memory>2097152</memory>
Nov 14 19:17:25 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:17:25 user nova-compute[75205]:   <metadata>
Nov 14 19:17:25 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:17:25 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:17:25 user nova-compute[75205]:       <nova:name>tempest-ServerActionsTestOtherB-server-1772840421</nova:name>
Nov 14 19:17:25 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:17:23</nova:creationTime>
Nov 14 19:17:25 user nova-compute[75205]:       <nova:flavor name="m1.small">
Nov 14 19:17:25 user nova-compute[75205]:         <nova:memory>2048</nova:memory>
Nov 14 19:17:25 user nova-compute[75205]:         <nova:disk>20</nova:disk>
Nov 14 19:17:25 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:17:25 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:17:25 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:17:25 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:17:25 user nova-compute[75205]:       <nova:owner>
Nov 14 19:17:25 user nova-compute[75205]:         <nova:user uuid="614f7aa49ee045c1a3cd9d23cb6bdebe">tempest-ServerActionsTestOtherB-938366899-project-member</nova:user>
Nov 14 19:17:25 user nova-compute[75205]:         <nova:project uuid="41ef713467204951b8d5433d80805441">tempest-ServerActionsTestOtherB-938366899</nova:project>
Nov 14 19:17:25 user nova-compute[75205]:       </nova:owner>
Nov 14 19:17:25 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:17:25 user nova-compute[75205]:       <nova:ports>
Nov 14 19:17:25 user nova-compute[75205]:         <nova:port uuid="814f09b6-754e-4e78-947a-6a7c488019e0">
Nov 14 19:17:25 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 19:17:25 user nova-compute[75205]:         </nova:port>
Nov 14 19:17:25 user nova-compute[75205]:       </nova:ports>
Nov 14 19:17:25 user nova-compute[75205]:     </nova:instance>
Nov 14 19:17:25 user nova-compute[75205]:   </metadata>
Nov 14 19:17:25 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:17:25 user nova-compute[75205]:     <system>
Nov 14 19:17:25 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:17:25 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:17:25 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:17:25 user nova-compute[75205]:       <entry name="serial">c7744d82-c045-4602-9d7a-83f7d331a77e</entry>
Nov 14 19:17:25 user nova-compute[75205]:       <entry name="uuid">c7744d82-c045-4602-9d7a-83f7d331a77e</entry>
Nov 14 19:17:25 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:17:25 user nova-compute[75205]:     </system>
Nov 14 19:17:25 user nova-compute[75205]:   </sysinfo>
Nov 14 19:17:25 user nova-compute[75205]:   <os>
Nov 14 19:17:25 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:17:25 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:17:25 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:17:25 user nova-compute[75205]:   </os>
Nov 14 19:17:25 user nova-compute[75205]:   <features>
Nov 14 19:17:25 user nova-compute[75205]:     <acpi/>
Nov 14 19:17:25 user nova-compute[75205]:     <apic/>
Nov 14 19:17:25 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:17:25 user nova-compute[75205]:   </features>
Nov 14 19:17:25 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:17:25 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:17:25 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:17:25 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:17:25 user nova-compute[75205]:   </clock>
Nov 14 19:17:25 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:17:25 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:17:25 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:17:25 user nova-compute[75205]:   </cpu>
Nov 14 19:17:25 user nova-compute[75205]:   <devices>
Nov 14 19:17:25 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:17:25 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:17:25 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk"/>
Nov 14 19:17:25 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:17:25 user nova-compute[75205]:     </disk>
Nov 14 19:17:25 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:17:25 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:17:25 user nova-compute[75205]:       <source dev="/dev/sde"/>
Nov 14 19:17:25 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:17:25 user nova-compute[75205]:       <serial>e61131b2-12a0-4593-85bd-155d9fcc8c96</serial>
Nov 14 19:17:25 user nova-compute[75205]:     </disk>
Nov 14 19:17:25 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:17:25 user nova-compute[75205]:       <mac address="fa:16:3e:c6:53:01"/>
Nov 14 19:17:25 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:17:25 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:17:25 user nova-compute[75205]:       <target dev="tap814f09b6-75"/>
Nov 14 19:17:25 user nova-compute[75205]:     </interface>
Nov 14 19:17:25 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:17:25 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/console.log" append="off"/>
Nov 14 19:17:25 user nova-compute[75205]:     </serial>
Nov 14 19:17:25 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:17:25 user nova-compute[75205]:     <video>
Nov 14 19:17:25 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:17:25 user nova-compute[75205]:     </video>
Nov 14 19:17:25 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:17:25 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:17:25 user nova-compute[75205]:     </rng>
Nov 14 19:17:25 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:17:25 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:17:25 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:17:25 user nova-compute[75205]:     </memballoon>
Nov 14 19:17:25 user nova-compute[75205]:   </devices>
Nov 14 19:17:25 user nova-compute[75205]: </domain>
Nov 14 19:17:25 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1772840421',display_name='tempest-ServerActionsTestOtherB-server-1772840421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1772840421',id=19,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUvKLnxFaWKfqQ4S/vwP+KIMyYqWAdaytSw3dniXzUF4xEGN7HlZuv7hGHWqxL9ir7W3jD5e9NmeSnZ82sU02gBYwBF2DuOPl6Jkk6gX2AGI1xcTXp5bR0/Q/rxf2ub4A==',key_name='tempest-keypair-444037287',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41ef713467204951b8d5433d80805441',ramdisk_id='',reservation_id='r-5k36qfa4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-938366899',owner_user_name='tempest-ServerActionsTestOtherB-938366899-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614f7aa49ee045c1a3cd9d23cb6bdebe',uuid=c7744d82-c045-4602-9d7a-83f7d331a77e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-862995617-network", "vif_mac": "fa:16:3e:c6:53:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converting VIF {"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-862995617-network", "vif_mac": "fa:16:3e:c6:53:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_vif [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c79cea11-da97-55ad-a257-e596651392d7', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap814f09b6-75, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap814f09b6-75, col_values=(('qos', UUID('76e41e41-9ea1-44cc-b457-86191f4a25bc')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap814f09b6-75, col_values=(('external_ids', {'iface-id': '814f09b6-754e-4e78-947a-6a7c488019e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:53:01', 'vm-uuid': 'c7744d82-c045-4602-9d7a-83f7d331a77e'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:25 user nova-compute[75205]: INFO os_vif [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75')
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] No VIF found with MAC fa:16:3e:c6:53:01, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:17:25 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72306b76-6bec-433a-ac37-e28218c3a265 is timed out.
Nov 14 19:17:25 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully detached device vdb from instance 72306b76-6bec-433a-ac37-e28218c3a265 from the live domain config.
Nov 14 19:17:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhdnATHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:17:25 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2da9ce-5aba-4aaf-823a-714fa6b315d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:17:25 user nova-compute[75205]: No targets found.
Nov 14 19:17:25 user nova-compute[75205]: iSNS:
Nov 14 19:17:25 user nova-compute[75205]: No targets found.
Nov 14 19:17:25 user nova-compute[75205]: STATIC:
Nov 14 19:17:25 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:17:25 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:17:25 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:17:25 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7
Nov 14 19:17:25 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:17:25 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:17:25 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01
Nov 14 19:17:25 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:17:25 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:17:25 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:17:25 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:17:25 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:17:25 user nova-compute[75205]: FIRMWARE:
Nov 14 19:17:25 user nova-compute[75205]: No targets found.
Nov 14 19:17:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:17:25 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:17:25 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2372da13-7942-4d0f-9a04-5df0a6bb5b9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d29d9e-bbcb-4056-8314-c9d88aa19fa3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:25 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:25 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:25 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:17:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:17:25 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:17:25 user nova-compute[75205]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 (non-flash)
Nov 14 19:17:25 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:17:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb74147490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01'): ({'sdd'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Removing single pathed devices sdd {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4cb02e-c71b-40f5-b9f1-be4bdce47569]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f349daca-8e40-4c43-9c13-668fcad18b11]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flushing IO for device /dev/sdd {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f304ec-0bbd-4141-ad5a-b70a957a6cc1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fa4f57-97e8-42a4-850e-db756ff1e70d]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1453d1c-032b-4b6a-959c-4712657e6822]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[13acee73-5e67-4487-9f08-86d0205c2af4]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01, portal: 172.16.0.220,3260]
Nov 14 19:17:26 user nova-compute[75205]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01, portal: 172.16.0.220,3260] successful.
Nov 14 19:17:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6094f5-7227-4b36-bb01-cce95aa4eb01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf7fe12-8a16-46b0-bd0e-f546b64cf772]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] <== disconnect_volume: return (372ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'flavor' on Instance uuid 72306b76-6bec-433a-ac37-e28218c3a265 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a566c26-454d-460d-85a9-48b788f40fba tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.956s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-bdc5c971-7f93-4349-89a2-7ccfa76bd766 req-d6fce59e-0493-472c-a98a-6d19e51a137c service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bdc5c971-7f93-4349-89a2-7ccfa76bd766 req-d6fce59e-0493-472c-a98a-6d19e51a137c service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bdc5c971-7f93-4349-89a2-7ccfa76bd766 req-d6fce59e-0493-472c-a98a-6d19e51a137c service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bdc5c971-7f93-4349-89a2-7ccfa76bd766 req-d6fce59e-0493-472c-a98a-6d19e51a137c service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-bdc5c971-7f93-4349-89a2-7ccfa76bd766 req-d6fce59e-0493-472c-a98a-6d19e51a137c service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:27 user nova-compute[75205]: WARNING nova.compute.manager [req-bdc5c971-7f93-4349-89a2-7ccfa76bd766 req-d6fce59e-0493-472c-a98a-6d19e51a137c service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state active and task_state resize_finish.
Nov 14 19:17:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Updating instance_info_cache with network_info: [{"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:27 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:17:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:17:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-dacb397f-d2db-4db5-80ba-214498acc497 req-db6ad321-c2c4-4de8-aa6e-42e985452ef3 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dacb397f-d2db-4db5-80ba-214498acc497 req-db6ad321-c2c4-4de8-aa6e-42e985452ef3 service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dacb397f-d2db-4db5-80ba-214498acc497 req-db6ad321-c2c4-4de8-aa6e-42e985452ef3 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dacb397f-d2db-4db5-80ba-214498acc497 req-db6ad321-c2c4-4de8-aa6e-42e985452ef3 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-dacb397f-d2db-4db5-80ba-214498acc497 req-db6ad321-c2c4-4de8-aa6e-42e985452ef3 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:29 user nova-compute[75205]: WARNING nova.compute.manager [req-dacb397f-d2db-4db5-80ba-214498acc497 req-db6ad321-c2c4-4de8-aa6e-42e985452ef3 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state active and task_state resize_finish.
Nov 14 19:17:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:17:29 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance running successfully.
Nov 14 19:17:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Failed to set time: agent not configured {{(pid=75205) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c48c114b-a5c0-406e-bbf4-d38abcc04f35 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] finish_migration finished successfully. {{(pid=75205) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:17:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:17:33 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:17:33 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7122MB free_disk=24.972694396972656GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Applying migration context for instance c7744d82-c045-4602-9d7a-83f7d331a77e as it has an incoming, in-progress migration d363b2d7-52bb-47b9-8b0f-ac3acfabddeb. Migration status is finished {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 19:17:33 user nova-compute[75205]: INFO nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating resource usage from migration d363b2d7-52bb-47b9-8b0f-ac3acfabddeb
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6864c442-8284-4dd8-8165-ff891e5d5175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 72306b76-6bec-433a-ac37-e28218c3a265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance fa1515bc-fa72-467e-ae09-54908b54fafa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d2dc6293-853a-4d75-83d3-511e5814e471 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3c53f075-6a96-4961-a89f-a5afffe1711f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2a32bb26-deb4-407d-a9e9-31de887e0b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 87a00d85-b082-4f6e-8869-987e01a91fa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Migration d363b2d7-52bb-47b9-8b0f-ac3acfabddeb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance c7744d82-c045-4602-9d7a-83f7d331a77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:17:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:17:34 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:17:34 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:17:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:17:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:34 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:17:34 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:17:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:17:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "72306b76-6bec-433a-ac37-e28218c3a265" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "72306b76-6bec-433a-ac37-e28218c3a265-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:55 user nova-compute[75205]: INFO nova.compute.manager [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Terminating instance
Nov 14 19:17:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-9e07fd17-b0e1-425e-868f-38a2ccd163c4 req-90c69add-a40e-48ae-9977-9573e14c393f service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received event network-vif-unplugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9e07fd17-b0e1-425e-868f-38a2ccd163c4 req-90c69add-a40e-48ae-9977-9573e14c393f service nova] Acquiring lock "72306b76-6bec-433a-ac37-e28218c3a265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9e07fd17-b0e1-425e-868f-38a2ccd163c4 req-90c69add-a40e-48ae-9977-9573e14c393f service nova] Lock "72306b76-6bec-433a-ac37-e28218c3a265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9e07fd17-b0e1-425e-868f-38a2ccd163c4 req-90c69add-a40e-48ae-9977-9573e14c393f service nova] Lock "72306b76-6bec-433a-ac37-e28218c3a265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-9e07fd17-b0e1-425e-868f-38a2ccd163c4 req-90c69add-a40e-48ae-9977-9573e14c393f service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] No waiting events found dispatching network-vif-unplugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-9e07fd17-b0e1-425e-868f-38a2ccd163c4 req-90c69add-a40e-48ae-9977-9573e14c393f service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received event network-vif-unplugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:17:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:56 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Instance destroyed successfully.
Nov 14 19:17:56 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'resources' on Instance uuid 72306b76-6bec-433a-ac37-e28218c3a265 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1803558853',display_name='tempest-AttachVolumeNegativeTest-server-1803558853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1803558853',id=22,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEj1nb6XRe42eVQ/cQa9EOnwxurjF6XOmzM+yCWgKrgOZr3fXRiUdUJIQSeBwGLLTgNMXpebmrgGsQV/QkLjRTN1NWcVg5fTBIqcXPwcTJyBnKB00Zy/24MDOUf5LZoXQ==',key_name='tempest-keypair-1060394141',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:15:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-0bpc6ezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=72306b76-6bec-433a-ac37-e28218c3a265,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "address": "fa:16:3e:85:17:05", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2872a8e-ef", "ovs_interfaceid": "e2872a8e-ef72-45a5-a1b1-7221021badc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:17:05,bridge_name='br-int',has_traffic_filtering=True,id=e2872a8e-ef72-45a5-a1b1-7221021badc4,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2872a8e-ef') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG os_vif [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:17:05,bridge_name='br-int',has_traffic_filtering=True,id=e2872a8e-ef72-45a5-a1b1-7221021badc4,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2872a8e-ef') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2872a8e-ef, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85589ac7-5a7e-42ec-b674-f306077e0250) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:56 user nova-compute[75205]: INFO os_vif [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:17:05,bridge_name='br-int',has_traffic_filtering=True,id=e2872a8e-ef72-45a5-a1b1-7221021badc4,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2872a8e-ef')
Nov 14 19:17:56 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Deleting instance files /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265_del
Nov 14 19:17:56 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Deletion of /opt/stack/data/nova/instances/72306b76-6bec-433a-ac37-e28218c3a265_del complete
Nov 14 19:17:56 user nova-compute[75205]: INFO nova.compute.manager [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 19:17:56 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:17:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:17:57 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:17:57 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Took 0.81 seconds to deallocate network for instance.
Nov 14 19:17:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-be36c163-a630-4ada-9126-671873a3b684 req-23ed453b-84ff-4883-97a9-aaddfdede32e service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received event network-vif-deleted-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:57 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:17:57 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:17:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:57 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Deleted allocations for instance 72306b76-6bec-433a-ac37-e28218c3a265
Nov 14 19:17:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7d1b1d3-d5bf-47d3-9b1b-0c54efcf0be2 req-9170be98-d756-4df5-9a39-8e1988ce67c8 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received event network-vif-plugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:17:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7d1b1d3-d5bf-47d3-9b1b-0c54efcf0be2 req-9170be98-d756-4df5-9a39-8e1988ce67c8 service nova] Acquiring lock "72306b76-6bec-433a-ac37-e28218c3a265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:17:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7d1b1d3-d5bf-47d3-9b1b-0c54efcf0be2 req-9170be98-d756-4df5-9a39-8e1988ce67c8 service nova] Lock "72306b76-6bec-433a-ac37-e28218c3a265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:17:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c7d1b1d3-d5bf-47d3-9b1b-0c54efcf0be2 req-9170be98-d756-4df5-9a39-8e1988ce67c8 service nova] Lock "72306b76-6bec-433a-ac37-e28218c3a265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:17:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-c7d1b1d3-d5bf-47d3-9b1b-0c54efcf0be2 req-9170be98-d756-4df5-9a39-8e1988ce67c8 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] No waiting events found dispatching network-vif-plugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:17:57 user nova-compute[75205]: WARNING nova.compute.manager [req-c7d1b1d3-d5bf-47d3-9b1b-0c54efcf0be2 req-9170be98-d756-4df5-9a39-8e1988ce67c8 service nova] [instance: 72306b76-6bec-433a-ac37-e28218c3a265] Received unexpected event network-vif-plugged-e2872a8e-ef72-45a5-a1b1-7221021badc4 for instance with vm_state deleted and task_state None.
Nov 14 19:17:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8c3d4b41-081a-46ba-aa87-ca63fb8a6e91 tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "72306b76-6bec-433a-ac37-e28218c3a265" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.351s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-6af4fcfe-0e42-4cd6-9a8a-6dacd31af242 req-df982bec-67f1-43ca-9d98-bd1c969f58fe service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received event network-changed-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-6af4fcfe-0e42-4cd6-9a8a-6dacd31af242 req-df982bec-67f1-43ca-9d98-bd1c969f58fe service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Refreshing instance network info cache due to event network-changed-e75f4677-5a08-457c-9625-1c200a6552c3. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:18:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6af4fcfe-0e42-4cd6-9a8a-6dacd31af242 req-df982bec-67f1-43ca-9d98-bd1c969f58fe service nova] Acquiring lock "refresh_cache-fa1515bc-fa72-467e-ae09-54908b54fafa" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:18:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6af4fcfe-0e42-4cd6-9a8a-6dacd31af242 req-df982bec-67f1-43ca-9d98-bd1c969f58fe service nova] Acquired lock "refresh_cache-fa1515bc-fa72-467e-ae09-54908b54fafa" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:18:10 user nova-compute[75205]: DEBUG nova.network.neutron [req-6af4fcfe-0e42-4cd6-9a8a-6dacd31af242 req-df982bec-67f1-43ca-9d98-bd1c969f58fe service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Refreshing network info cache for port e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:18:10 user nova-compute[75205]: DEBUG nova.network.neutron [req-6af4fcfe-0e42-4cd6-9a8a-6dacd31af242 req-df982bec-67f1-43ca-9d98-bd1c969f58fe service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Updated VIF entry in instance network info cache for port e75f4677-5a08-457c-9625-1c200a6552c3. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:18:10 user nova-compute[75205]: DEBUG nova.network.neutron [req-6af4fcfe-0e42-4cd6-9a8a-6dacd31af242 req-df982bec-67f1-43ca-9d98-bd1c969f58fe service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Updating instance_info_cache with network_info: [{"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:18:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6af4fcfe-0e42-4cd6-9a8a-6dacd31af242 req-df982bec-67f1-43ca-9d98-bd1c969f58fe service nova] Releasing lock "refresh_cache-fa1515bc-fa72-467e-ae09-54908b54fafa" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lazy-loading 'flavor' on Instance uuid fa1515bc-fa72-467e-ae09-54908b54fafa {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:11 user nova-compute[75205]: INFO nova.compute.manager [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Attaching volume 6f0cdbe5-e304-4a66-a8bd-065510523b8a to /dev/vdb
Nov 14 19:18:11 user nova-compute[75205]: DEBUG os_brick.utils [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b274033-9c32-47c0-9641-0e44f844b6d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c0480e-d4d8-4a37-9161-898fbe31543d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3db2ee-32cb-40e8-af07-5309ef524bfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[147d5619-3e78-4414-8575-de5cc9ae6c5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:18:11 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:18:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b822745b-183a-4e5b-b088-eb191b21c421]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG os_brick.utils [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:11 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Updating existing volume attachment record: a693d084-7219-47eb-9db0-39a1038ad1fb {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaWZtmuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:16 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:18:16 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:18:16 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:18:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a493e184-6dfe-4945-b27c-4ae335986038]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:18:16 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1e038c-6178-4a2b-8344-e0f849e856d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a] added
Nov 14 19:18:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[236df8bc-0b19-4505-a823-09c34bf6d4f7]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[79384435-fd93-4914-a7b5-47e2dac7b095]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FaWZtmuw {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FaWZtmuw" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2a62df-b190-47ce-8617-594808e3417e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FaWZtmuw'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c0d774-6426-4026-96a3-995a8ae309bd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e715e032-21a7-4b81-8824-3d744c36d30c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[461d9257-615e-4cc6-87ba-a561b4847977]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a, portal: 172.16.0.220,3260]
Nov 14 19:18:16 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a, portal: 172.16.0.220,3260] successful.
Nov 14 19:18:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aa51c9-e005-4e6b-b714-94ef14c38813]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db59e29-2203-4ba7-b28d-c9ef59d25122]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:16 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9887e58-af41-434e-8f30-4c7784113731]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaWZtmuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:18:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:18:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23465616234386565', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465616234386565', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:18:17 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lazy-loading 'flavor' on Instance uuid fa1515bc-fa72-467e-ae09-54908b54fafa {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:18:17 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:18:17 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:18:17 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:18:17 user nova-compute[75205]:   <serial>6f0cdbe5-e304-4a66-a8bd-065510523b8a</serial>
Nov 14 19:18:17 user nova-compute[75205]: </disk>
Nov 14 19:18:17 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:18:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:18:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:18:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] No VIF found with MAC fa:16:3e:cd:60:ae, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:18:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5e4aa23a-6349-45c0-b0c9-66bd4edcd8a9 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.539s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lazy-loading 'flavor' on Instance uuid fa1515bc-fa72-467e-ae09-54908b54fafa {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:21 user nova-compute[75205]: INFO nova.compute.manager [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Attaching volume 7f9c8e26-fee5-417c-b2a7-627d1414613e to /dev/vdc
Nov 14 19:18:21 user nova-compute[75205]: DEBUG os_brick.utils [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e882aa81-7546-4a70-acb6-690f5eb95190]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0eb5cd-7f0f-4ab6-b77a-de986d5b7c14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[916c774c-4607-424a-a396-56ea65879b3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e9e76b-f675-4ce6-ab54-e542c5404458]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:18:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:18:22 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:18:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdc3287-ca84-4a4b-a4a0-d24768737871]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:18:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:18:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:18:22 user nova-compute[75205]: DEBUG os_brick.utils [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:22 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Updating existing volume attachment record: 9ed643aa-0b72-4c75-921f-e2133add657f {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuaeFOVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:26 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:18:26 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:18:26 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[622df140-b3e4-41eb-add3-959fcd34460a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:18:26 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[19299513-c030-4260-ad68-89a5345e0468]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e] added
Nov 14 19:18:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1a801e-c981-4b4e-a189-3d54c2b255d1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057719a-0e49-4f1e-97fc-8a55640e3f1b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuaeFOVP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuaeFOVP" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3852e0db-faa6-46c6-928b-36c129db1113]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LuaeFOVP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da1905e-bb1d-4b84-9f6b-03b551543525]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[734f00db-6cab-4e41-ae07-da30e6b59fbf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63682a5-d318-45ed-91b6-65e65ff8af2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e, portal: 172.16.0.220,3260]
Nov 14 19:18:26 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e, portal: 172.16.0.220,3260] successful.
Nov 14 19:18:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6208c2-3059-43a7-941f-ec1bbff75aea]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3bb9a2-86a3-44a4-a7e1-3b45df7454a8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)
Nov 14 19:18:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:26 user nova-compute[75205]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)
Nov 14 19:18:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.043s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17f9f40-392b-4686-a00f-17a50bc2e5f0]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:18:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuaeFOVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:18:27 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:18:27 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:18:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:18:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23361323531626331', 'path': '/dev/sdf'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361323531626331', 'path': '/dev/sdf'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:18:27 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lazy-loading 'flavor' on Instance uuid fa1515bc-fa72-467e-ae09-54908b54fafa {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:18:27 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:18:27 user nova-compute[75205]:   <source dev="/dev/sdf"/>
Nov 14 19:18:27 user nova-compute[75205]:   <target dev="vdc" bus="virtio"/>
Nov 14 19:18:27 user nova-compute[75205]:   <serial>7f9c8e26-fee5-417c-b2a7-627d1414613e</serial>
Nov 14 19:18:27 user nova-compute[75205]: </disk>
Nov 14 19:18:27 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] No VIF found with MAC fa:16:3e:cd:60:ae, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3e12c716-39a5-446a-80f4-07b05311041d tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.629s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Updating instance_info_cache with network_info: [{"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:18:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:29 user nova-compute[75205]: INFO nova.compute.manager [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Detaching volume 7f9c8e26-fee5-417c-b2a7-627d1414613e
Nov 14 19:18:29 user nova-compute[75205]: INFO nova.virt.block_device [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Attempting to driver detach volume 7f9c8e26-fee5-417c-b2a7-627d1414613e from mountpoint /dev/vdc
Nov 14 19:18:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Attempting to detach device vdc from instance fa1515bc-fa72-467e-ae09-54908b54fafa from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:18:29 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:18:29 user nova-compute[75205]:   <source dev="/dev/sdf"/>
Nov 14 19:18:29 user nova-compute[75205]:   <target dev="vdc" bus="virtio"/>
Nov 14 19:18:29 user nova-compute[75205]:   <serial>7f9c8e26-fee5-417c-b2a7-627d1414613e</serial>
Nov 14 19:18:29 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 19:18:29 user nova-compute[75205]: </disk>
Nov 14 19:18:29 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:18:29 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Successfully detached device vdc from instance fa1515bc-fa72-467e-ae09-54908b54fafa from the persistent domain config.
Nov 14 19:18:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fa1515bc-fa72-467e-ae09-54908b54fafa from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:18:29 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:18:29 user nova-compute[75205]:   <source dev="/dev/sdf"/>
Nov 14 19:18:29 user nova-compute[75205]:   <target dev="vdc" bus="virtio"/>
Nov 14 19:18:29 user nova-compute[75205]:   <serial>7f9c8e26-fee5-417c-b2a7-627d1414613e</serial>
Nov 14 19:18:29 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 19:18:29 user nova-compute[75205]: </disk>
Nov 14 19:18:29 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fa1515bc-fa72-467e-ae09-54908b54fafa {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d2dc6293-853a-4d75-83d3-511e5814e471" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:30 user nova-compute[75205]: INFO nova.compute.manager [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Terminating instance
Nov 14 19:18:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-3628cac3-89f2-402c-85b5-ff8f94654fa8 req-09cc3132-e555-4a85-b997-7af5ccc18eb7 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-unplugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3628cac3-89f2-402c-85b5-ff8f94654fa8 req-09cc3132-e555-4a85-b997-7af5ccc18eb7 service nova] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3628cac3-89f2-402c-85b5-ff8f94654fa8 req-09cc3132-e555-4a85-b997-7af5ccc18eb7 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3628cac3-89f2-402c-85b5-ff8f94654fa8 req-09cc3132-e555-4a85-b997-7af5ccc18eb7 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-3628cac3-89f2-402c-85b5-ff8f94654fa8 req-09cc3132-e555-4a85-b997-7af5ccc18eb7 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] No waiting events found dispatching network-vif-unplugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-3628cac3-89f2-402c-85b5-ff8f94654fa8 req-09cc3132-e555-4a85-b997-7af5ccc18eb7 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-unplugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Instance destroyed successfully.
Nov 14 19:18:31 user nova-compute[75205]: DEBUG nova.objects.instance [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'resources' on Instance uuid d2dc6293-853a-4d75-83d3-511e5814e471 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1915365756',display_name='tempest-TestVolumeBootPattern-server-1915365756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1915365756',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:16:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-77rgxv9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:16:57Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=d2dc6293-853a-4d75-83d3-511e5814e471,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "address": "fa:16:3e:04:d3:a8", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c4b7f0-bb", "ovs_interfaceid": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "address": "fa:16:3e:04:d3:a8", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c4b7f0-bb", "ovs_interfaceid": "d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:a8,bridge_name='br-int',has_traffic_filtering=True,id=d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c4b7f0-bb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_vif [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:a8,bridge_name='br-int',has_traffic_filtering=True,id=d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c4b7f0-bb') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4c4b7f0-bb, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d28dac0b-ada1-4729-8de6-458a1e051183) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:18:31 user nova-compute[75205]: INFO os_vif [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:a8,bridge_name='br-int',has_traffic_filtering=True,id=d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c4b7f0-bb')
Nov 14 19:18:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnaIHVqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:31 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8aee03-4ab9-424c-96e1-28f788a02c42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:18:31 user nova-compute[75205]: No targets found.
Nov 14 19:18:31 user nova-compute[75205]: iSNS:
Nov 14 19:18:31 user nova-compute[75205]: No targets found.
Nov 14 19:18:31 user nova-compute[75205]: STATIC:
Nov 14 19:18:31 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e
Nov 14 19:18:31 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:18:31 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:18:31 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a
Nov 14 19:18:31 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:18:31 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:18:31 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:18:31 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:18:31 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:18:31 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7
Nov 14 19:18:31 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:18:31 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:18:31 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:18:31 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:18:31 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:18:31 user nova-compute[75205]: FIRMWARE:
Nov 14 19:18:31 user nova-compute[75205]: No targets found.
Nov 14 19:18:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:18:31 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:18:31 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e7d6ad-7119-4641-81a3-cdf25639be4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd02abe-9ab1-4839-b2a3-8570f4ff3f09]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:31 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:18:31 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:31 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:31 user nova-compute[75205]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)
Nov 14 19:18:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:31 user nova-compute[75205]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 (non-flash)
Nov 14 19:18:31 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:31 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:31 user nova-compute[75205]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)
Nov 14 19:18:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb5478e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b3f5f5-cebb-4f29-b568-41edbe11738a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b6dda-47db-4df7-b471-aba19faeecc9]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b23580-fafe-4de6-87f3-ea69eb48d6d4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[900d075a-02bd-49cc-a013-1ec8231cbfaf]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c29050e1', '/dev/disk/by-id/scsi-26431383535646465', '/dev/disk/by-id/scsi-1SCST_BIOc29050e1-d1855dde1c2638d5') {{(pid=85714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 19:18:31 user nova-compute[75205]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c29050e1
Nov 14 19:18:31 user nova-compute[75205]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26431383535646465
Nov 14 19:18:31 user nova-compute[75205]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc29050e1-d1855dde1c2638d5
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fee88be-12e0-4771-b6bd-db6f3b61480f]: (4, None) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:18:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3cde55-57e4-4428-8bbe-880673aa67f9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1e2fb-9cb5-4665-895a-116136b279f6]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7, portal: 172.16.0.220,3260]
Nov 14 19:18:32 user nova-compute[75205]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7, portal: 172.16.0.220,3260] successful.
Nov 14 19:18:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc68451-acc5-45ef-b44a-8cd5934bed7c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== disconnect_volume: return (449ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:18:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Deleting instance files /opt/stack/data/nova/instances/d2dc6293-853a-4d75-83d3-511e5814e471_del
Nov 14 19:18:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Deletion of /opt/stack/data/nova/instances/d2dc6293-853a-4d75-83d3-511e5814e471_del complete
Nov 14 19:18:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:32 user nova-compute[75205]: INFO nova.compute.manager [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-ab848948-6439-4687-9ba8-56d0c4dc0b0f req-e4d5aeae-6171-40c1-a5a1-99609669b00f service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-deleted-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:32 user nova-compute[75205]: INFO nova.compute.manager [req-ab848948-6439-4687-9ba8-56d0c4dc0b0f req-e4d5aeae-6171-40c1-a5a1-99609669b00f service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Neutron deleted interface d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1; detaching it from the instance and deleting it from the info cache
Nov 14 19:18:32 user nova-compute[75205]: DEBUG nova.network.neutron [req-ab848948-6439-4687-9ba8-56d0c4dc0b0f req-e4d5aeae-6171-40c1-a5a1-99609669b00f service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:18:32 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Took 0.57 seconds to deallocate network for instance.
Nov 14 19:18:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-ab848948-6439-4687-9ba8-56d0c4dc0b0f req-e4d5aeae-6171-40c1-a5a1-99609669b00f service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Detach interface failed, port_id=d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1, reason: Instance d2dc6293-853a-4d75-83d3-511e5814e471 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] No waiting events found dispatching network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:33 user nova-compute[75205]: WARNING nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received unexpected event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 for instance with vm_state active and task_state deleting.
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] No waiting events found dispatching network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:33 user nova-compute[75205]: WARNING nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received unexpected event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 for instance with vm_state active and task_state deleting.
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] No waiting events found dispatching network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:33 user nova-compute[75205]: WARNING nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received unexpected event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 for instance with vm_state active and task_state deleting.
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-unplugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] No waiting events found dispatching network-vif-unplugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-unplugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Acquiring lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] Lock "d2dc6293-853a-4d75-83d3-511e5814e471-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] No waiting events found dispatching network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:33 user nova-compute[75205]: WARNING nova.compute.manager [req-cb020927-1507-4f21-9f62-19d1189be2dc req-56aeccf3-ff24-46fc-9f9e-3331f7bbc124 service nova] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Received unexpected event network-vif-plugged-d4c4b7f0-bb2a-4d7e-ac47-0fd60dab88a1 for instance with vm_state active and task_state deleting.
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:18:33 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid 'd2dc6293-853a-4d75-83d3-511e5814e471' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd2dc6293-853a-4d75-83d3-511e5814e471' (instance-00000018)
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:33 user nova-compute[75205]: INFO nova.compute.manager [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 19:18:33 user nova-compute[75205]: DEBUG nova.compute.manager [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d2dc6293-853a-4d75-83d3-511e5814e471] Deleting volume: d5fe02a5-cbfa-4a0b-8641-0a49dcc9e3f7 {{(pid=75205) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:34 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Deleted allocations for instance d2dc6293-853a-4d75-83d3-511e5814e471
Nov 14 19:18:34 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:18:34 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7200MB free_disk=24.99612808227539GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-53a3979e-4f46-4de9-9446-e0e18aeea8ed tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d2dc6293-853a-4d75-83d3-511e5814e471" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.878s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Applying migration context for instance c7744d82-c045-4602-9d7a-83f7d331a77e as it has an incoming, in-progress migration d363b2d7-52bb-47b9-8b0f-ac3acfabddeb. Migration status is finished {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 19:18:34 user nova-compute[75205]: INFO nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating resource usage from migration d363b2d7-52bb-47b9-8b0f-ac3acfabddeb
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6864c442-8284-4dd8-8165-ff891e5d5175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance fa1515bc-fa72-467e-ae09-54908b54fafa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3c53f075-6a96-4961-a89f-a5afffe1711f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2a32bb26-deb4-407d-a9e9-31de887e0b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 87a00d85-b082-4f6e-8869-987e01a91fa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Migration d363b2d7-52bb-47b9-8b0f-ac3acfabddeb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance c7744d82-c045-4602-9d7a-83f7d331a77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:18:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:18:35 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:18:35 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:18:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:18:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:36 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:18:36 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:18:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:18:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:18:39 user nova-compute[75205]: INFO nova.compute.claims [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Claim successful on node user
Nov 14 19:18:40 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:18:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:18:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG nova.policy [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f89ca9b3c52040acbc46581ac5cf55b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55021da245654f6392681359d51cbc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:18:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Creating image(s)
Nov 14 19:18:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "/opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "/opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "/opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.190s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk 1073741824" returned: 0 in 0.049s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Successfully created port: 7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Cannot resize image /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Ensure instance console log exists: /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Successfully updated port: 7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "refresh_cache-76a6c07f-15b9-4640-bc5a-8f288c7aba99" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquired lock "refresh_cache-76a6c07f-15b9-4640-bc5a-8f288c7aba99" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-bbbc8028-ba5b-47c1-bfbe-0fb514f5e090 req-8feffdea-8271-4a22-9285-102c7e9b433c service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-changed-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-bbbc8028-ba5b-47c1-bfbe-0fb514f5e090 req-8feffdea-8271-4a22-9285-102c7e9b433c service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Refreshing instance network info cache due to event network-changed-7989cadb-ee49-4c2e-836f-655dc71f5576. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bbbc8028-ba5b-47c1-bfbe-0fb514f5e090 req-8feffdea-8271-4a22-9285-102c7e9b433c service nova] Acquiring lock "refresh_cache-76a6c07f-15b9-4640-bc5a-8f288c7aba99" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Updating instance_info_cache with network_info: [{"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Releasing lock "refresh_cache-76a6c07f-15b9-4640-bc5a-8f288c7aba99" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Instance network_info: |[{"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bbbc8028-ba5b-47c1-bfbe-0fb514f5e090 req-8feffdea-8271-4a22-9285-102c7e9b433c service nova] Acquired lock "refresh_cache-76a6c07f-15b9-4640-bc5a-8f288c7aba99" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-bbbc8028-ba5b-47c1-bfbe-0fb514f5e090 req-8feffdea-8271-4a22-9285-102c7e9b433c service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Refreshing network info cache for port 7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Start _get_guest_xml network_info=[{"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:18:42 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:18:42 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-54069087',display_name='tempest-tempest.common.compute-instance-54069087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-54069087',id=28,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmFMu1MhmNNODqxye2oYQgfRj0rdLs44i/hgnq8MB347rg/uZ2vJKnDG8bTLCgPOHpMZNKcMILt0sMLy2yvyzP3vcTosOElc4xxRalFM4BT+P3pJ71xkhxpnimPcAPydA==',key_name='tempest-keypair-137945461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-yx5vb0xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:18:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=76a6c07f-15b9-4640-bc5a-8f288c7aba99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'pci_devices' on Instance uuid 76a6c07f-15b9-4640-bc5a-8f288c7aba99 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:18:42 user nova-compute[75205]:   <uuid>76a6c07f-15b9-4640-bc5a-8f288c7aba99</uuid>
Nov 14 19:18:42 user nova-compute[75205]:   <name>instance-0000001c</name>
Nov 14 19:18:42 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:18:42 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:18:42 user nova-compute[75205]:   <metadata>
Nov 14 19:18:42 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:18:42 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:18:42 user nova-compute[75205]:       <nova:name>tempest-tempest.common.compute-instance-54069087</nova:name>
Nov 14 19:18:42 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:18:42</nova:creationTime>
Nov 14 19:18:42 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:18:42 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:18:42 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:18:42 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:18:42 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:18:42 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:18:42 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:18:42 user nova-compute[75205]:       <nova:owner>
Nov 14 19:18:42 user nova-compute[75205]:         <nova:user uuid="f89ca9b3c52040acbc46581ac5cf55b9">tempest-ServerActionsTestOtherA-410645410-project-member</nova:user>
Nov 14 19:18:42 user nova-compute[75205]:         <nova:project uuid="55021da245654f6392681359d51cbc9d">tempest-ServerActionsTestOtherA-410645410</nova:project>
Nov 14 19:18:42 user nova-compute[75205]:       </nova:owner>
Nov 14 19:18:42 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:18:42 user nova-compute[75205]:       <nova:ports>
Nov 14 19:18:42 user nova-compute[75205]:         <nova:port uuid="7989cadb-ee49-4c2e-836f-655dc71f5576">
Nov 14 19:18:42 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 19:18:42 user nova-compute[75205]:         </nova:port>
Nov 14 19:18:42 user nova-compute[75205]:       </nova:ports>
Nov 14 19:18:42 user nova-compute[75205]:     </nova:instance>
Nov 14 19:18:42 user nova-compute[75205]:   </metadata>
Nov 14 19:18:42 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:18:42 user nova-compute[75205]:     <system>
Nov 14 19:18:42 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:18:42 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:18:42 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:18:42 user nova-compute[75205]:       <entry name="serial">76a6c07f-15b9-4640-bc5a-8f288c7aba99</entry>
Nov 14 19:18:42 user nova-compute[75205]:       <entry name="uuid">76a6c07f-15b9-4640-bc5a-8f288c7aba99</entry>
Nov 14 19:18:42 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:18:42 user nova-compute[75205]:     </system>
Nov 14 19:18:42 user nova-compute[75205]:   </sysinfo>
Nov 14 19:18:42 user nova-compute[75205]:   <os>
Nov 14 19:18:42 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:18:42 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:18:42 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:18:42 user nova-compute[75205]:   </os>
Nov 14 19:18:42 user nova-compute[75205]:   <features>
Nov 14 19:18:42 user nova-compute[75205]:     <acpi/>
Nov 14 19:18:42 user nova-compute[75205]:     <apic/>
Nov 14 19:18:42 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:18:42 user nova-compute[75205]:   </features>
Nov 14 19:18:42 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:18:42 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:18:42 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:18:42 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:18:42 user nova-compute[75205]:   </clock>
Nov 14 19:18:42 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:18:42 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:18:42 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:18:42 user nova-compute[75205]:   </cpu>
Nov 14 19:18:42 user nova-compute[75205]:   <devices>
Nov 14 19:18:42 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:18:42 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:18:42 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk"/>
Nov 14 19:18:42 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:18:42 user nova-compute[75205]:     </disk>
Nov 14 19:18:42 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:18:42 user nova-compute[75205]:       <mac address="fa:16:3e:3d:74:7e"/>
Nov 14 19:18:42 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:18:42 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:18:42 user nova-compute[75205]:       <target dev="tap7989cadb-ee"/>
Nov 14 19:18:42 user nova-compute[75205]:     </interface>
Nov 14 19:18:42 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:18:42 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/console.log" append="off"/>
Nov 14 19:18:42 user nova-compute[75205]:     </serial>
Nov 14 19:18:42 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:18:42 user nova-compute[75205]:     <video>
Nov 14 19:18:42 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:18:42 user nova-compute[75205]:     </video>
Nov 14 19:18:42 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:18:42 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:18:42 user nova-compute[75205]:     </rng>
Nov 14 19:18:42 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:18:42 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:18:42 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:18:42 user nova-compute[75205]:     </memballoon>
Nov 14 19:18:42 user nova-compute[75205]:   </devices>
Nov 14 19:18:42 user nova-compute[75205]: </domain>
Nov 14 19:18:42 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-54069087',display_name='tempest-tempest.common.compute-instance-54069087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-54069087',id=28,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmFMu1MhmNNODqxye2oYQgfRj0rdLs44i/hgnq8MB347rg/uZ2vJKnDG8bTLCgPOHpMZNKcMILt0sMLy2yvyzP3vcTosOElc4xxRalFM4BT+P3pJ71xkhxpnimPcAPydA==',key_name='tempest-keypair-137945461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-yx5vb0xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:18:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=76a6c07f-15b9-4640-bc5a-8f288c7aba99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG os_vif [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '762001bf-9582-5e1f-b211-9fcaff99caeb', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7989cadb-ee, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7989cadb-ee, col_values=(('qos', UUID('863f8992-3ec2-4833-b128-20dbbefa8626')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7989cadb-ee, col_values=(('external_ids', {'iface-id': '7989cadb-ee49-4c2e-836f-655dc71f5576', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:74:7e', 'vm-uuid': '76a6c07f-15b9-4640-bc5a-8f288c7aba99'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:42 user nova-compute[75205]: INFO os_vif [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee')
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No VIF found with MAC fa:16:3e:3d:74:7e, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-bbbc8028-ba5b-47c1-bfbe-0fb514f5e090 req-8feffdea-8271-4a22-9285-102c7e9b433c service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Updated VIF entry in instance network info cache for port 7989cadb-ee49-4c2e-836f-655dc71f5576. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-bbbc8028-ba5b-47c1-bfbe-0fb514f5e090 req-8feffdea-8271-4a22-9285-102c7e9b433c service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Updating instance_info_cache with network_info: [{"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:18:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bbbc8028-ba5b-47c1-bfbe-0fb514f5e090 req-8feffdea-8271-4a22-9285-102c7e9b433c service nova] Releasing lock "refresh_cache-76a6c07f-15b9-4640-bc5a-8f288c7aba99" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-d15ec52e-4b07-4988-bd98-9b7e5e8635a1 req-f7afbed6-15b6-410c-8894-ad100ff0eb64 service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received event network-changed-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-d15ec52e-4b07-4988-bd98-9b7e5e8635a1 req-f7afbed6-15b6-410c-8894-ad100ff0eb64 service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Refreshing instance network info cache due to event network-changed-a1c75ae0-844b-4b14-a4d8-77f116a65a6c. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d15ec52e-4b07-4988-bd98-9b7e5e8635a1 req-f7afbed6-15b6-410c-8894-ad100ff0eb64 service nova] Acquiring lock "refresh_cache-3c53f075-6a96-4961-a89f-a5afffe1711f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d15ec52e-4b07-4988-bd98-9b7e5e8635a1 req-f7afbed6-15b6-410c-8894-ad100ff0eb64 service nova] Acquired lock "refresh_cache-3c53f075-6a96-4961-a89f-a5afffe1711f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-d15ec52e-4b07-4988-bd98-9b7e5e8635a1 req-f7afbed6-15b6-410c-8894-ad100ff0eb64 service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Refreshing network info cache for port a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG nova.objects.instance [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lazy-loading 'flavor' on Instance uuid 3c53f075-6a96-4961-a89f-a5afffe1711f {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-d15ec52e-4b07-4988-bd98-9b7e5e8635a1 req-f7afbed6-15b6-410c-8894-ad100ff0eb64 service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Updated VIF entry in instance network info cache for port a1c75ae0-844b-4b14-a4d8-77f116a65a6c. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-d15ec52e-4b07-4988-bd98-9b7e5e8635a1 req-f7afbed6-15b6-410c-8894-ad100ff0eb64 service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Updating instance_info_cache with network_info: [{"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d15ec52e-4b07-4988-bd98-9b7e5e8635a1 req-f7afbed6-15b6-410c-8894-ad100ff0eb64 service nova] Releasing lock "refresh_cache-3c53f075-6a96-4961-a89f-a5afffe1711f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:43 user nova-compute[75205]: INFO nova.compute.manager [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Attaching volume 1c5cf31b-254a-4476-8e80-6f75078710fa to /dev/vdb
Nov 14 19:18:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG os_brick.utils [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91cb800-527e-41ac-9706-0d9cc0789000]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58b171f-21f2-41bb-b1ce-80c408385546]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e5a9c6-5a3a-4d9e-807b-90cd1d88ee2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b951c8-a476-42ef-a8cf-fedea87aafb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:18:44 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3931947b-2677-4a1a-ba67-57f108c8ee6f]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG os_brick.utils [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Updating existing volume attachment record: 71fbea7c-9e13-42cb-9631-530fc306c6ed {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-2c22b227-6d80-4ca8-a65d-ef8192b622f7 req-1859d2c8-43b0-4394-8729-f8c302d9a75e service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2c22b227-6d80-4ca8-a65d-ef8192b622f7 req-1859d2c8-43b0-4394-8729-f8c302d9a75e service nova] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2c22b227-6d80-4ca8-a65d-ef8192b622f7 req-1859d2c8-43b0-4394-8729-f8c302d9a75e service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2c22b227-6d80-4ca8-a65d-ef8192b622f7 req-1859d2c8-43b0-4394-8729-f8c302d9a75e service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-2c22b227-6d80-4ca8-a65d-ef8192b622f7 req-1859d2c8-43b0-4394-8729-f8c302d9a75e service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] No waiting events found dispatching network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:44 user nova-compute[75205]: WARNING nova.compute.manager [req-2c22b227-6d80-4ca8-a65d-ef8192b622f7 req-1859d2c8-43b0-4394-8729-f8c302d9a75e service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received unexpected event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 for instance with vm_state building and task_state spawning.
Nov 14 19:18:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:18:45 user nova-compute[75205]: INFO nova.compute.manager [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] instance snapshotting
Nov 14 19:18:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Beginning live snapshot process
Nov 14 19:18:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json -f qcow2 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json -f qcow2 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqccap95_/d298ccd278cb4e51a621106736020ed2.delta 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqccap95_/d298ccd278cb4e51a621106736020ed2.delta 1073741824" returned: 0 in 0.052s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:18:46 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Instance spawned successfully.
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-456f4bbc-135b-4baa-bdb0-d7c38c2ddd93 req-576f0900-9e98-4c46-bb03-0825001f7c0b service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-456f4bbc-135b-4baa-bdb0-d7c38c2ddd93 req-576f0900-9e98-4c46-bb03-0825001f7c0b service nova] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-456f4bbc-135b-4baa-bdb0-d7c38c2ddd93 req-576f0900-9e98-4c46-bb03-0825001f7c0b service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-456f4bbc-135b-4baa-bdb0-d7c38c2ddd93 req-576f0900-9e98-4c46-bb03-0825001f7c0b service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-456f4bbc-135b-4baa-bdb0-d7c38c2ddd93 req-576f0900-9e98-4c46-bb03-0825001f7c0b service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] No waiting events found dispatching network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:46 user nova-compute[75205]: WARNING nova.compute.manager [req-456f4bbc-135b-4baa-bdb0-d7c38c2ddd93 req-576f0900-9e98-4c46-bb03-0825001f7c0b service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received unexpected event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 for instance with vm_state building and task_state spawning.
Nov 14 19:18:46 user nova-compute[75205]: INFO nova.compute.manager [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:18:46 user nova-compute[75205]: INFO nova.compute.manager [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Took 6.47 seconds to build instance.
Nov 14 19:18:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ff367051-75ce-4a45-9d82-ad5f83114e6e tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.566s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:18:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:18:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 19:18:47 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:18:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqccap95_/d298ccd278cb4e51a621106736020ed2.delta /opt/stack/data/nova/instances/snapshots/tmpqccap95_/d298ccd278cb4e51a621106736020ed2 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqccap95_/d298ccd278cb4e51a621106736020ed2.delta /opt/stack/data/nova/instances/snapshots/tmpqccap95_/d298ccd278cb4e51a621106736020ed2" returned: 0 in 0.288s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Snapshot extracted, beginning image upload
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecCfFIzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:49 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:18:49 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:18:49 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:18:49 user nova-compute[75205]: INFO nova.compute.claims [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Claim successful on node user
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a554f29-0f9d-454d-a563-115f212f81a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:18:49 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2043ea92-a5cb-4038-bdbc-c37683473670]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa] added
Nov 14 19:18:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b050d6bc-828f-46c9-9959-0b40cd8cf415]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[602ebb6a-8aad-43aa-ab64-df43afecd105]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ecCfFIzV {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ecCfFIzV" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f3b462-88a8-45ef-b01b-5847eab2269a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ecCfFIzV'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e600874-380f-4632-b5d3-0098b91b2e38]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ca39a3-763b-47b4-bc8a-85614a5fc4c4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)
Nov 14 19:18:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)
Nov 14 19:18:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5fc6b0-3c29-4b8c-a0d3-87026c8474e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260]
Nov 14 19:18:49 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260] successful.
Nov 14 19:18:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6667e0-2418-40b2-a81b-aca43ca14de4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e0ec7-d202-4b14-bf69-07b544c60086]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:18:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)
Nov 14 19:18:49 user nova-compute[75205]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:18:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[49520c97-38b1-4806-aaa3-e018d059f517]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:18:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecCfFIzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:18:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Snapshot image upload complete
Nov 14 19:18:50 user nova-compute[75205]: INFO nova.compute.manager [None req-b52acec6-abc0-4e2d-a93f-ca79032879f9 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Took 5.22 seconds to snapshot the instance on the hypervisor.
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:18:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:18:50 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance fa1515bc-fa72-467e-ae09-54908b54fafa is timed out.
Nov 14 19:18:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Successfully detached device vdc from instance fa1515bc-fa72-467e-ae09-54908b54fafa from the live domain config.
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuaeFOVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:50 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.policy [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '792e949c53df4fe390f93c0118590bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42501d5d4964f49b8fe62e9c9c2bd24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:18:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Creating image(s)
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "/opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "/opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk 1073741824" returned: 0 in 0.052s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26538353936396563', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538353936396563', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.600s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.objects.instance [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lazy-loading 'flavor' on Instance uuid 3c53f075-6a96-4961-a89f-a5afffe1711f {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[021b7f21-3ee1-41a9-ae9a-8fb010b91bfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:18:50 user nova-compute[75205]: No targets found.
Nov 14 19:18:50 user nova-compute[75205]: iSNS:
Nov 14 19:18:50 user nova-compute[75205]: No targets found.
Nov 14 19:18:50 user nova-compute[75205]: STATIC:
Nov 14 19:18:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e
Nov 14 19:18:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:18:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:18:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a
Nov 14 19:18:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:18:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:18:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa
Nov 14 19:18:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:18:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:18:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:18:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:18:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:18:50 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:18:50 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:18:50 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:18:50 user nova-compute[75205]: FIRMWARE:
Nov 14 19:18:50 user nova-compute[75205]: No targets found.
Nov 14 19:18:50 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:18:50 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:18:50 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9468da-ba9c-4368-a27a-acfe538d4862]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:18:50 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:18:50 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:18:50 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:18:50 user nova-compute[75205]:   <serial>1c5cf31b-254a-4476-8e80-6f75078710fa</serial>
Nov 14 19:18:50 user nova-compute[75205]: </disk>
Nov 14 19:18:50 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bf5a50-0012-4204-81c7-84644be8bae5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:50 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:50 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:50 user nova-compute[75205]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)
Nov 14 19:18:50 user nova-compute[75205]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:18:50 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:50 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:50 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:50 user nova-compute[75205]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e (non-flash)
Nov 14 19:18:50 user nova-compute[75205]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:18:50 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb5478b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e'): ({'sdf'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Removing single pathed devices sdf {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Successfully created port: 9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[831387f1-f3f6-4f06-ab4f-ae48be6a9dbd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a63b22a-e081-4f65-8c00-553dd5209786]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:50 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Flushing IO for device /dev/sdf {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26fcec1-7a0e-4a13-b312-ee6a0ad4ed1a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.235s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.066s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d8ce83-340f-4391-ab4d-132c74e92afe]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] SCSI volumes sdf have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39bd5c3-2755-49fe-8021-a270ef561416]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a86a8b-21ce-4564-98ef-885a26edf44d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e, portal: 172.16.0.220,3260]
Nov 14 19:18:51 user nova-compute[75205]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e, portal: 172.16.0.220,3260] successful.
Nov 14 19:18:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9c8e26-fee5-417c-b2a7-627d1414613e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d425e6d6-2b16-467c-902f-37e2772b79cc]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] <== disconnect_volume: return (1004ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Cannot resize image /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Ensure instance console log exists: /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] No VIF found with MAC fa:16:3e:7c:41:70, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1ca52f73-50b2-43cb-a891-d6cc909e9560 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.561s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Successfully updated port: 9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "refresh_cache-7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquired lock "refresh_cache-7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-cf04e456-bc3b-46ba-bc70-ee034e8abdf6 req-eb6ff9a9-b68f-4103-90f7-0ec1d080a7b0 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received event network-changed-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-cf04e456-bc3b-46ba-bc70-ee034e8abdf6 req-eb6ff9a9-b68f-4103-90f7-0ec1d080a7b0 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Refreshing instance network info cache due to event network-changed-9c1f080d-e8d5-4c84-95c4-4e638a14c190. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cf04e456-bc3b-46ba-bc70-ee034e8abdf6 req-eb6ff9a9-b68f-4103-90f7-0ec1d080a7b0 service nova] Acquiring lock "refresh_cache-7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Updating instance_info_cache with network_info: [{"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Releasing lock "refresh_cache-7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Instance network_info: |[{"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cf04e456-bc3b-46ba-bc70-ee034e8abdf6 req-eb6ff9a9-b68f-4103-90f7-0ec1d080a7b0 service nova] Acquired lock "refresh_cache-7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.network.neutron [req-cf04e456-bc3b-46ba-bc70-ee034e8abdf6 req-eb6ff9a9-b68f-4103-90f7-0ec1d080a7b0 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Refreshing network info cache for port 9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Start _get_guest_xml network_info=[{"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:18:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:18:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:18:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2104997043',display_name='tempest-AttachVolumeNegativeTest-server-2104997043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2104997043',id=29,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRAUXaCL0aehlodpjtzFf34EvHRZnkh8gUn0H8V5fQF7HPEuaJUsNn3+aTgkdDGJEFQpZS6JCEJ7RtkNG4rWhv4bweh+YBL2fVfr8ycO+WCbUbnuoUMqpdElxIOj9A5bA==',key_name='tempest-keypair-2104889956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-jmda6nji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=7e78a0e9-0d9a-4b00-a9e2-f5fd69517707,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b7:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c1f080d-e8d5-4c84-95c4-4e638a14c190,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1f080d-e8') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:18:52 user nova-compute[75205]:   <uuid>7e78a0e9-0d9a-4b00-a9e2-f5fd69517707</uuid>
Nov 14 19:18:52 user nova-compute[75205]:   <name>instance-0000001d</name>
Nov 14 19:18:52 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:18:52 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:18:52 user nova-compute[75205]:   <metadata>
Nov 14 19:18:52 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:18:52 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:18:52 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2104997043</nova:name>
Nov 14 19:18:52 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:18:51</nova:creationTime>
Nov 14 19:18:52 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:18:52 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:18:52 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:18:52 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:18:52 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:18:52 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:18:52 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:18:52 user nova-compute[75205]:       <nova:owner>
Nov 14 19:18:52 user nova-compute[75205]:         <nova:user uuid="792e949c53df4fe390f93c0118590bb6">tempest-AttachVolumeNegativeTest-1777396465-project-member</nova:user>
Nov 14 19:18:52 user nova-compute[75205]:         <nova:project uuid="d42501d5d4964f49b8fe62e9c9c2bd24">tempest-AttachVolumeNegativeTest-1777396465</nova:project>
Nov 14 19:18:52 user nova-compute[75205]:       </nova:owner>
Nov 14 19:18:52 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:18:52 user nova-compute[75205]:       <nova:ports>
Nov 14 19:18:52 user nova-compute[75205]:         <nova:port uuid="9c1f080d-e8d5-4c84-95c4-4e638a14c190">
Nov 14 19:18:52 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:18:52 user nova-compute[75205]:         </nova:port>
Nov 14 19:18:52 user nova-compute[75205]:       </nova:ports>
Nov 14 19:18:52 user nova-compute[75205]:     </nova:instance>
Nov 14 19:18:52 user nova-compute[75205]:   </metadata>
Nov 14 19:18:52 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:18:52 user nova-compute[75205]:     <system>
Nov 14 19:18:52 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:18:52 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:18:52 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:18:52 user nova-compute[75205]:       <entry name="serial">7e78a0e9-0d9a-4b00-a9e2-f5fd69517707</entry>
Nov 14 19:18:52 user nova-compute[75205]:       <entry name="uuid">7e78a0e9-0d9a-4b00-a9e2-f5fd69517707</entry>
Nov 14 19:18:52 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:18:52 user nova-compute[75205]:     </system>
Nov 14 19:18:52 user nova-compute[75205]:   </sysinfo>
Nov 14 19:18:52 user nova-compute[75205]:   <os>
Nov 14 19:18:52 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:18:52 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:18:52 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:18:52 user nova-compute[75205]:   </os>
Nov 14 19:18:52 user nova-compute[75205]:   <features>
Nov 14 19:18:52 user nova-compute[75205]:     <acpi/>
Nov 14 19:18:52 user nova-compute[75205]:     <apic/>
Nov 14 19:18:52 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:18:52 user nova-compute[75205]:   </features>
Nov 14 19:18:52 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:18:52 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:18:52 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:18:52 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:18:52 user nova-compute[75205]:   </clock>
Nov 14 19:18:52 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:18:52 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:18:52 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:18:52 user nova-compute[75205]:   </cpu>
Nov 14 19:18:52 user nova-compute[75205]:   <devices>
Nov 14 19:18:52 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:18:52 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:18:52 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk"/>
Nov 14 19:18:52 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:18:52 user nova-compute[75205]:     </disk>
Nov 14 19:18:52 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:18:52 user nova-compute[75205]:       <mac address="fa:16:3e:c8:b7:9c"/>
Nov 14 19:18:52 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:18:52 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:18:52 user nova-compute[75205]:       <target dev="tap9c1f080d-e8"/>
Nov 14 19:18:52 user nova-compute[75205]:     </interface>
Nov 14 19:18:52 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:18:52 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/console.log" append="off"/>
Nov 14 19:18:52 user nova-compute[75205]:     </serial>
Nov 14 19:18:52 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:18:52 user nova-compute[75205]:     <video>
Nov 14 19:18:52 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:18:52 user nova-compute[75205]:     </video>
Nov 14 19:18:52 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:18:52 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:18:52 user nova-compute[75205]:     </rng>
Nov 14 19:18:52 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:18:52 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:18:52 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:18:52 user nova-compute[75205]:     </memballoon>
Nov 14 19:18:52 user nova-compute[75205]:   </devices>
Nov 14 19:18:52 user nova-compute[75205]: </domain>
Nov 14 19:18:52 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2104997043',display_name='tempest-AttachVolumeNegativeTest-server-2104997043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2104997043',id=29,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRAUXaCL0aehlodpjtzFf34EvHRZnkh8gUn0H8V5fQF7HPEuaJUsNn3+aTgkdDGJEFQpZS6JCEJ7RtkNG4rWhv4bweh+YBL2fVfr8ycO+WCbUbnuoUMqpdElxIOj9A5bA==',key_name='tempest-keypair-2104889956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-jmda6nji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=7e78a0e9-0d9a-4b00-a9e2-f5fd69517707,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b7:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c1f080d-e8d5-4c84-95c4-4e638a14c190,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1f080d-e8') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG os_vif [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b7:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c1f080d-e8d5-4c84-95c4-4e638a14c190,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1f080d-e8') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39944d23-f4c1-5e71-a83f-f348ba582cf9', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c1f080d-e8, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c1f080d-e8, col_values=(('qos', UUID('ea4d9d69-de05-4fb1-a47c-070063ff5d00')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c1f080d-e8, col_values=(('external_ids', {'iface-id': '9c1f080d-e8d5-4c84-95c4-4e638a14c190', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:b7:9c', 'vm-uuid': '7e78a0e9-0d9a-4b00-a9e2-f5fd69517707'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:52 user nova-compute[75205]: INFO os_vif [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b7:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c1f080d-e8d5-4c84-95c4-4e638a14c190,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1f080d-e8')
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.objects.instance [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lazy-loading 'flavor' on Instance uuid fa1515bc-fa72-467e-ae09-54908b54fafa {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No VIF found with MAC fa:16:3e:c8:b7:9c, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bfe4df20-02cd-4e80-a9c0-ed6aa504598c tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.515s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-cf04e456-bc3b-46ba-bc70-ee034e8abdf6 req-eb6ff9a9-b68f-4103-90f7-0ec1d080a7b0 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Updated VIF entry in instance network info cache for port 9c1f080d-e8d5-4c84-95c4-4e638a14c190. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-cf04e456-bc3b-46ba-bc70-ee034e8abdf6 req-eb6ff9a9-b68f-4103-90f7-0ec1d080a7b0 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Updating instance_info_cache with network_info: [{"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:18:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cf04e456-bc3b-46ba-bc70-ee034e8abdf6 req-eb6ff9a9-b68f-4103-90f7-0ec1d080a7b0 service nova] Releasing lock "refresh_cache-7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG os_brick.utils [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[842c3c91-1a4d-48f8-8bfd-3a24206c5142]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4097dba5-9e72-4a12-8bf6-b5169df0e9cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adc653a-1da5-445d-bc78-8d59f331208a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5c12c0-4b19-4119-93dd-40e8b763e772]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:18:53 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f1c5b7-6668-4327-b7b1-81d2e290bd91]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG os_brick.utils [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:53 user nova-compute[75205]: INFO nova.compute.manager [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Swapping volume 1c5cf31b-254a-4476-8e80-6f75078710fa for 5359d0c8-5799-4388-a714-fb771cfc6d6b
Nov 14 19:18:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-9a73dc34-00d5-42eb-bb46-5543280d2307 req-91cb0897-14d7-43ae-9764-ff87f18a840a service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received event network-vif-plugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9a73dc34-00d5-42eb-bb46-5543280d2307 req-91cb0897-14d7-43ae-9764-ff87f18a840a service nova] Acquiring lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9a73dc34-00d5-42eb-bb46-5543280d2307 req-91cb0897-14d7-43ae-9764-ff87f18a840a service nova] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9a73dc34-00d5-42eb-bb46-5543280d2307 req-91cb0897-14d7-43ae-9764-ff87f18a840a service nova] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-9a73dc34-00d5-42eb-bb46-5543280d2307 req-91cb0897-14d7-43ae-9764-ff87f18a840a service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] No waiting events found dispatching network-vif-plugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:53 user nova-compute[75205]: WARNING nova.compute.manager [req-9a73dc34-00d5-42eb-bb46-5543280d2307 req-91cb0897-14d7-43ae-9764-ff87f18a840a service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received unexpected event network-vif-plugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 for instance with vm_state building and task_state spawning.
Nov 14 19:18:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:18:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Instance spawned successfully.
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:18:55 user nova-compute[75205]: INFO nova.compute.manager [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-c128db47-1747-4f9a-863a-377f53945433 req-5ac50c80-c506-4bc0-8e41-3b54b3232894 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received event network-vif-plugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c128db47-1747-4f9a-863a-377f53945433 req-5ac50c80-c506-4bc0-8e41-3b54b3232894 service nova] Acquiring lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c128db47-1747-4f9a-863a-377f53945433 req-5ac50c80-c506-4bc0-8e41-3b54b3232894 service nova] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c128db47-1747-4f9a-863a-377f53945433 req-5ac50c80-c506-4bc0-8e41-3b54b3232894 service nova] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-c128db47-1747-4f9a-863a-377f53945433 req-5ac50c80-c506-4bc0-8e41-3b54b3232894 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] No waiting events found dispatching network-vif-plugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:55 user nova-compute[75205]: WARNING nova.compute.manager [req-c128db47-1747-4f9a-863a-377f53945433 req-5ac50c80-c506-4bc0-8e41-3b54b3232894 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received unexpected event network-vif-plugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 for instance with vm_state building and task_state spawning.
Nov 14 19:18:55 user nova-compute[75205]: INFO nova.compute.manager [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Took 6.32 seconds to build instance.
Nov 14 19:18:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f0fc7335-6555-4565-95a7-e9652f7942cd tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.429s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:57 user nova-compute[75205]: INFO nova.compute.manager [None req-14cee7cb-7a30-4fb3-b09f-54abcaa0f0d1 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Unrescuing
Nov 14 19:18:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-14cee7cb-7a30-4fb3-b09f-54abcaa0f0d1 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:18:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-14cee7cb-7a30-4fb3-b09f-54abcaa0f0d1 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquired lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:18:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-14cee7cb-7a30-4fb3-b09f-54abcaa0f0d1 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:18:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-14cee7cb-7a30-4fb3-b09f-54abcaa0f0d1 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Updating instance_info_cache with network_info: [{"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:18:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-14cee7cb-7a30-4fb3-b09f-54abcaa0f0d1 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Releasing lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:18:57 user nova-compute[75205]: DEBUG nova.objects.instance [None req-14cee7cb-7a30-4fb3-b09f-54abcaa0f0d1 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'flavor' on Instance uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-45531973-b42f-4c0d-9a2b-e7ca9ac23da2 req-a7c931a7-43b6-40b6-8882-b54ac147eb4c service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-unplugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-45531973-b42f-4c0d-9a2b-e7ca9ac23da2 req-a7c931a7-43b6-40b6-8882-b54ac147eb4c service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-45531973-b42f-4c0d-9a2b-e7ca9ac23da2 req-a7c931a7-43b6-40b6-8882-b54ac147eb4c service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-45531973-b42f-4c0d-9a2b-e7ca9ac23da2 req-a7c931a7-43b6-40b6-8882-b54ac147eb4c service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-45531973-b42f-4c0d-9a2b-e7ca9ac23da2 req-a7c931a7-43b6-40b6-8882-b54ac147eb4c service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-unplugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:18:58 user nova-compute[75205]: WARNING nova.compute.manager [req-45531973-b42f-4c0d-9a2b-e7ca9ac23da2 req-a7c931a7-43b6-40b6-8882-b54ac147eb4c service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-unplugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:18:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNxupoZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3c53f075-6a96-4961-a89f-a5afffe1711f', 'attached_at': '', 'detached_at': '', 'volume_id': '5359d0c8-5799-4388-a714-fb771cfc6d6b', 'serial': '5359d0c8-5799-4388-a714-fb771cfc6d6b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecCfFIzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3c53f075-6a96-4961-a89f-a5afffe1711f', 'attached_at': '', 'detached_at': '', 'volume_id': '1c5cf31b-254a-4476-8e80-6f75078710fa', 'serial'} {{(pid=75205) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNxupoZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:58 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:18:58 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:18:58 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61ef22e-a96b-4625-9331-810e73ff8859]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:18:58 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9ad83b-1b12-45bf-a982-89aada556965]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b] added
Nov 14 19:18:58 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7d60f8-c5ef-463c-97c0-f2554b211515]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cfa946-ca1b-4a40-81de-dba614667772]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNxupoZy {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNxupoZy" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a248e5f7-b5f7-4bfe-8a2d-80f3a63c5e24]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vNxupoZy'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[57152bfb-dd54-4764-8bb9-a73aa9a98d16]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21575c2-d093-4c74-a009-792c524fc9ba]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:18:58 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:18:58 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f64f7ee-501f-4fd3-90f4-c07bdefefa71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b, portal: 172.16.0.220,3260]
Nov 14 19:18:58 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b, portal: 172.16.0.220,3260] successful.
Nov 14 19:18:58 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e2bb8a-c7ec-47b3-ab96-ae6220731299]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Instance destroyed successfully.
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c74971-8c39-4316-b7c4-6f5a2badb032]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:18:58 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:18:58 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:18:58 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b383b3b-a93e-498f-81b0-6a233852ae67]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNxupoZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "87a00d85-b082-4f6e-8869-987e01a91fa0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG nova.objects.instance [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lazy-loading 'flavor' on Instance uuid 87a00d85-b082-4f6e-8869-987e01a91fa0 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:18:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "87a00d85-b082-4f6e-8869-987e01a91fa0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:18:59 user nova-compute[75205]: INFO nova.compute.manager [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Attaching volume 86c809a8-de91-4ed0-889a-4356154ff90a to /dev/vdb
Nov 14 19:18:59 user nova-compute[75205]: DEBUG os_brick.utils [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[567edf27-f037-442c-bc4c-9368d3e83457]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece486f1-51c1-4563-a703-2b6b1f32c93e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[32690b6c-033e-4ab1-8140-a2a447d79d73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f09ab0-6461-4272-b86c-fa85584e5682]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:18:59 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:18:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4552fb-6c7d-416e-81e8-496049a4d472]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG os_brick.utils [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Updating existing volume attachment record: fd9e1491-aecf-4605-8ca0-7389955d64c6 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26234333230366130', 'path': '/dev/sdf'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234333230366130', 'path': '/dev/sdf'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:18:59 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lazy-loading 'flavor' on Instance uuid 3c53f075-6a96-4961-a89f-a5afffe1711f {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received event network-changed-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Refreshing instance network info cache due to event network-changed-6252e873-ddb2-4609-8706-f08ef733e5e0. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] Acquiring lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] Acquired lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG nova.network.neutron [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Refreshing network info cache for port 6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 183500800 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG nova.network.neutron [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Updated VIF entry in instance network info cache for port 6252e873-ddb2-4609-8706-f08ef733e5e0. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG nova.network.neutron [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Updating instance_info_cache with network_info: [{"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] Releasing lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:19:01 user nova-compute[75205]: WARNING nova.compute.manager [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:19:01 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:19:01 user nova-compute[75205]: WARNING nova.compute.manager [req-f8f89568-e41e-47f5-95b5-a87af5bb0347 req-96c8eb72-680f-48b7-aa95-0d96ad38a629 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:19:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 356515840 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 522190848 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 699400192 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-0b968180-ecf2-443d-aee3-483555b60f65 req-c9b2ed06-df88-4767-97e5-0b9a250e9ff5 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0b968180-ecf2-443d-aee3-483555b60f65 req-c9b2ed06-df88-4767-97e5-0b9a250e9ff5 service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0b968180-ecf2-443d-aee3-483555b60f65 req-c9b2ed06-df88-4767-97e5-0b9a250e9ff5 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0b968180-ecf2-443d-aee3-483555b60f65 req-c9b2ed06-df88-4767-97e5-0b9a250e9ff5 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-0b968180-ecf2-443d-aee3-483555b60f65 req-c9b2ed06-df88-4767-97e5-0b9a250e9ff5 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:19:02 user nova-compute[75205]: WARNING nova.compute.manager [req-0b968180-ecf2-443d-aee3-483555b60f65 req-c9b2ed06-df88-4767-97e5-0b9a250e9ff5 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:19:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Port 814f09b6-754e-4e78-947a-6a7c488019e0 binding to destination host user is already ACTIVE {{(pid=75205) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquired lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating instance_info_cache with network_info: [{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 870318080 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Releasing lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Creating tmpfile /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/tmpgwgu5sxi to verify with other compute node that the instance is on the same shared storage. {{(pid=75205) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG nova.compute.manager [None req-14cee7cb-7a30-4fb3-b09f-54abcaa0f0d1 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 1019215872 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8b68b31-146f-4748-bb6e-bef32e4ec9b2 req-a9701a10-3637-4e01-b66b-1a684ade109d service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-unplugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8b68b31-146f-4748-bb6e-bef32e4ec9b2 req-a9701a10-3637-4e01-b66b-1a684ade109d service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8b68b31-146f-4748-bb6e-bef32e4ec9b2 req-a9701a10-3637-4e01-b66b-1a684ade109d service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f8b68b31-146f-4748-bb6e-bef32e4ec9b2 req-a9701a10-3637-4e01-b66b-1a684ade109d service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-f8b68b31-146f-4748-bb6e-bef32e4ec9b2 req-a9701a10-3637-4e01-b66b-1a684ade109d service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-unplugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:19:03 user nova-compute[75205]: WARNING nova.compute.manager [req-f8b68b31-146f-4748-bb6e-bef32e4ec9b2 req-a9701a10-3637-4e01-b66b-1a684ade109d service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-unplugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state resized and task_state resize_reverting.
Nov 14 19:19:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:04 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance destroyed successfully.
Nov 14 19:19:04 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lazy-loading 'resources' on Instance uuid c7744d82-c045-4602-9d7a-83f7d331a77e {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecCfFIzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:04 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1772840421',display_name='tempest-ServerActionsTestOtherB-server-1772840421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1772840421',id=19,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUvKLnxFaWKfqQ4S/vwP+KIMyYqWAdaytSw3dniXzUF4xEGN7HlZuv7hGHWqxL9ir7W3jD5e9NmeSnZ82sU02gBYwBF2DuOPl6Jkk6gX2AGI1xcTXp5bR0/Q/rxf2ub4A==',key_name='tempest-keypair-444037287',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41ef713467204951b8d5433d80805441',ramdisk_id='',reservation_id='r-5k36qfa4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-938366899',owner_user_name='tempest-ServerActionsTestOtherB-938366899-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:17:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614f7aa49ee045c1a3cd9d23cb6bdebe',uuid=c7744d82-c045-4602-9d7a-83f7d331a77e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converting VIF {"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_vif [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap814f09b6-75, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76e41e41-9ea1-44cc-b457-86191f4a25bc) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:04 user nova-compute[75205]: INFO os_vif [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75')
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[21591eba-0e38-4dee-8441-bdfec3510725]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:19:04 user nova-compute[75205]: No targets found.
Nov 14 19:19:04 user nova-compute[75205]: iSNS:
Nov 14 19:19:04 user nova-compute[75205]: No targets found.
Nov 14 19:19:04 user nova-compute[75205]: STATIC:
Nov 14 19:19:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a
Nov 14 19:19:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b
Nov 14 19:19:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa
Nov 14 19:19:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:19:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:19:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:04 user nova-compute[75205]: FIRMWARE:
Nov 14 19:19:04 user nova-compute[75205]: No targets found.
Nov 14 19:19:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:19:04 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:19:04 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:04 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2595645-3964-49bb-ac3c-9c8469e97e06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[834a8cf1-22b2-46ee-bdc2-7e8a60758030]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb54789480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5254134e-6c99-4d46-b9b5-dabb03b3366a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[81791b5f-e569-4204-86ee-9674fa423ce9]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86fe25-9892-4c30-818f-3b60adf16015]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebe2985-6cfa-4d0b-a14f-17eefdf971cf]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87104d9-c1b9-471f-8ffa-afceb7e133fd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e31ee5-6896-404e-9f63-f4d6a43156f1]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260]
Nov 14 19:19:04 user nova-compute[75205]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260] successful.
Nov 14 19:19:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c063d934-6395-4b4e-9b89-4b2f6813dc6d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] <== disconnect_volume: return (323ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.292s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a56a84-dcf8-4dce-827c-9a13d5b26b58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:19:04 user nova-compute[75205]: No targets found.
Nov 14 19:19:04 user nova-compute[75205]: iSNS:
Nov 14 19:19:04 user nova-compute[75205]: No targets found.
Nov 14 19:19:04 user nova-compute[75205]: STATIC:
Nov 14 19:19:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a
Nov 14 19:19:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b
Nov 14 19:19:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:19:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:19:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:04 user nova-compute[75205]: FIRMWARE:
Nov 14 19:19:04 user nova-compute[75205]: No targets found.
Nov 14 19:19:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:19:04 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:19:04 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eb71e7-770b-413b-8ee2-b7ba91aae0c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e121adeb-5144-4918-aa8d-e44841471496]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:04 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb74625240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96'): ({'sde'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Removing single pathed devices sde {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNxupoZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '3c53f075-6a96-4961-a89f-a5afffe1711f', 'attached_at': '', 'detached_at': '', 'volume_id': '5359d0c8-5799-4388-a714-fb771cfc6d6b', 'serial'} {{(pid=75205) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] swap_volume: removing Cinder connection for volume 1c5cf31b-254a-4476-8e80-6f75078710fa {{(pid=75205) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea504f60-a457-410c-a183-01c0650f81ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9240c979-2cdb-4ef9-88f1-1cb6463c2704]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Flushing IO for device /dev/sde {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[919c144f-0678-4d4c-8d76-fbc4826cd3b6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda84003-a5b1-4156-854e-3bd569e395f9]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[36599de6-cc67-4db3-b687-a1e0b4ba29a6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f48616-1de9-444b-b840-a44a644b967c]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]
Nov 14 19:19:04 user nova-compute[75205]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.
Nov 14 19:19:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[897af4ba-3108-4165-95b3-d3190fb1ce0f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] <== disconnect_volume: return (613ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:19:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:05 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lazy-loading 'migration_context' on Instance uuid c7744d82-c045-4602-9d7a-83f7d331a77e {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:19:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-3cc2f3a7-ec81-4b46-afa8-a9ac3410e94b req-4e6352e9-9a54-4874-a069-9421789cc761 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:19:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3cc2f3a7-ec81-4b46-afa8-a9ac3410e94b req-4e6352e9-9a54-4874-a069-9421789cc761 service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3cc2f3a7-ec81-4b46-afa8-a9ac3410e94b req-4e6352e9-9a54-4874-a069-9421789cc761 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3cc2f3a7-ec81-4b46-afa8-a9ac3410e94b req-4e6352e9-9a54-4874-a069-9421789cc761 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-3cc2f3a7-ec81-4b46-afa8-a9ac3410e94b req-4e6352e9-9a54-4874-a069-9421789cc761 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:19:05 user nova-compute[75205]: WARNING nova.compute.manager [req-3cc2f3a7-ec81-4b46-afa8-a9ac3410e94b req-4e6352e9-9a54-4874-a069-9421789cc761 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state resized and task_state resize_reverting.
Nov 14 19:19:05 user nova-compute[75205]: DEBUG nova.objects.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Object Instance<c7744d82-c045-4602-9d7a-83f7d331a77e> lazy-loaded attributes: resources,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] swap_volume: Updating volume 1c5cf31b-254a-4476-8e80-6f75078710fa BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "vNxupoZy", "auth_password": "N5wTKY6MHtLyE7", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "5359d0c8-5799-4388-a714-fb771cfc6d6b"}, "status": "reserved", "instance": "3c53f075-6a96-4961-a89f-a5afffe1711f", "attached_at": "", "detached_at": "", "volume_id": "5359d0c8-5799-4388-a714-fb771cfc6d6b", "serial": "5359d0c8-5799-4388-a714-fb771cfc6d6b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5359d0c8-5799-4388-a714-fb771cfc6d6b', 'no_device': None, 'attachment_id': 'a9f14e97-912e-4380-92d5-07a447b4872c'} {{(pid=75205) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9c6c7ef8-199d-4a40-9bc6-40c1888f61c1 tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.977s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHiBQePG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:06 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:06 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:06 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ca99af-5365-4f7b-b8d2-b47ba60f2662]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:19:06 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[83854f57-9f2f-451b-b908-48b0d5c468f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a] added
Nov 14 19:19:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fd78ff-6320-46fa-9f81-d916a4afbaf0]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ffc86b-f979-4075-bbc6-037643bac69f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHiBQePG {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.538s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHiBQePG" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e196cdd-18c7-4c33-a01b-873fa5a2280f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHiBQePG'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[da298ad0-d2ba-4957-8fcf-413a90e5468b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8b1d1-b72c-4052-a983-6f993e3b25e3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:06 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:06 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:06 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:06 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[268f3568-f05f-4f97-9f6b-ec439eaf98e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a, portal: 172.16.0.220,3260]
Nov 14 19:19:06 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a, portal: 172.16.0.220,3260] successful.
Nov 14 19:19:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[512d3e3b-e4d9-4d70-b93b-e9c53743b363]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7577f38-a015-4a37-87c1-6bdc016a4f6a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:06 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:06 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:06 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:06 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:06 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:06 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4358c95-b4c3-4dd4-9ba1-a15aefe3bbae]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:19:06 user nova-compute[75205]: INFO nova.compute.manager [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Swapping old allocation on dict_keys(['7def1607-b7d5-4fc6-9f9d-da4f8e437fa8']) held by migration d363b2d7-52bb-47b9-8b0f-ac3acfabddeb for instance
Nov 14 19:19:06 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Overwriting current allocation {'allocations': {'7def1607-b7d5-4fc6-9f9d-da4f8e437fa8': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 34}}, 'project_id': '41ef713467204951b8d5433d80805441', 'user_id': '614f7aa49ee045c1a3cd9d23cb6bdebe', 'consumer_generation': 1} on consumer c7744d82-c045-4602-9d7a-83f7d331a77e {{(pid=75205) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquired lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:19:06 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating instance_info_cache with network_info: [{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Releasing lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.utils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ebba83-e3fb-420b-bb0a-50c3b316d246]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[191c8999-2635-48ac-9dd5-bec6bc710961]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d281943c-229c-48aa-9d2e-7332d25910c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad1922a-8dd3-4a91-ad2c-3355f17eb088]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHiBQePG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26631343033316332', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631343033316332', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:19:07 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa7779a-373f-453c-886e-c2f1bb7dc13a]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.utils [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.utils [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG nova.objects.instance [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lazy-loading 'flavor' on Instance uuid 87a00d85-b082-4f6e-8869-987e01a91fa0 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66222ce-32ce-4b44-bc54-8fd17198ddaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:19:07 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:19:07 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:19:07 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:19:07 user nova-compute[75205]:   <serial>86c809a8-de91-4ed0-889a-4356154ff90a</serial>
Nov 14 19:19:07 user nova-compute[75205]: </disk>
Nov 14 19:19:07 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9527c3e-2ceb-4be2-ad0b-0e5b7ff93596]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e523111-8bfc-47c1-b6ba-28cabbb147f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d9b7a-c9c4-44a6-8cbe-9181c435fffb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:19:07 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:19:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[68add18b-3044-43a9-8f92-d8d1a405b32b]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:19:07 user nova-compute[75205]: DEBUG os_brick.utils [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:07 user nova-compute[75205]: INFO nova.compute.manager [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Swapping volume 5359d0c8-5799-4388-a714-fb771cfc6d6b for 1c5cf31b-254a-4476-8e80-6f75078710fa
Nov 14 19:19:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:19:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:19:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] No VIF found with MAC fa:16:3e:ce:a9:ef, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:19:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-002c2c5c-4130-4d19-b2b9-aefd9db1daf1 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.058s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "87a00d85-b082-4f6e-8869-987e01a91fa0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:10 user nova-compute[75205]: INFO nova.compute.manager [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Detaching volume 86c809a8-de91-4ed0-889a-4356154ff90a
Nov 14 19:19:10 user nova-compute[75205]: INFO nova.virt.block_device [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Attempting to driver detach volume 86c809a8-de91-4ed0-889a-4356154ff90a from mountpoint /dev/vdb
Nov 14 19:19:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Attempting to detach device vdb from instance 87a00d85-b082-4f6e-8869-987e01a91fa0 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:19:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:19:10 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:19:10 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:19:10 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:19:10 user nova-compute[75205]:   <serial>86c809a8-de91-4ed0-889a-4356154ff90a</serial>
Nov 14 19:19:10 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:19:10 user nova-compute[75205]: </disk>
Nov 14 19:19:10 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:19:10 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Successfully detached device vdb from instance 87a00d85-b082-4f6e-8869-987e01a91fa0 from the persistent domain config.
Nov 14 19:19:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87a00d85-b082-4f6e-8869-987e01a91fa0 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:19:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:19:10 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:19:10 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:19:10 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:19:10 user nova-compute[75205]:   <serial>86c809a8-de91-4ed0-889a-4356154ff90a</serial>
Nov 14 19:19:10 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:19:10 user nova-compute[75205]: </disk>
Nov 14 19:19:10 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:19:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87a00d85-b082-4f6e-8869-987e01a91fa0 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:19:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecCfFIzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3c53f075-6a96-4961-a89f-a5afffe1711f', 'attached_at': '', 'detached_at': '', 'volume_id': '1c5cf31b-254a-4476-8e80-6f75078710fa', 'serial': '1c5cf31b-254a-4476-8e80-6f75078710fa'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNxupoZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '5359d0c8-5799-4388-a714-fb771cfc6d6b'}, 'status': 'reserved', 'instance': '3c53f075-6a96-4961-a89f-a5afffe1711f', 'attached_at': '', 'detached_at': '', 'volume_id': '5359d0c8-5799-4388-a714-fb771cfc6d6b', 'serial'} {{(pid=75205) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecCfFIzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:16 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:16 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:16 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Starting finish_revert_migration {{(pid=75205) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ef879f-69a1-4a7d-9561-09ae89a4f171]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:19:16 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Start _get_guest_xml network_info=[{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c7744d82-c045-4602-9d7a-83f7d331a77e', 'attached_at': '2023-11-14T19:19:16.000000', 'detached_at': '', 'volume_id': 'e61131b2-12a0-4593-85bd-155d9fcc8c96', 'serial': 'e61131b2-12a0-4593-85bd-155d9fcc8c96'}, 'attachment_id': '8a44665d-fb73-46a5-ac9c-19f921a19ac5', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:19:16 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:19:16 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[52adc4a4-708c-4c7c-8152-d0a4b9ff2e6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa] added
Nov 14 19:19:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7744d82-c045-4602-9d7a-83f7d331a77e {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:16 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b42974-683f-4999-bbc3-bceb59264d3d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7cbe25-18fa-4e24-a2bf-2ce0306a1eec]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ecCfFIzV {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ecCfFIzV" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[458b1902-6f3d-4150-aa4e-8ed349935ac1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ecCfFIzV'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[20245763-0981-48a2-81af-2113eafb055c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[70275b50-6f84-4822-84ff-15763b2494bd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97d302b-c8bb-4e1e-bd22-887aebd14f7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260]
Nov 14 19:19:16 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260] successful.
Nov 14 19:19:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1d8ebf-0793-4df6-86e2-e4e3b019c3cd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c2ce44-d2e9-4aef-917a-52a4012f12ac]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:16 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa49c6-a759-4038-af5e-b04f094ada3a]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:19:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecCfFIzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26538353936396563', 'path': '/dev/sde'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538353936396563', 'path': '/dev/sde'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.249s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:17 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:17 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:19:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG nova.objects.instance [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lazy-loading 'flavor' on Instance uuid 3c53f075-6a96-4961-a89f-a5afffe1711f {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0b384-78d7-4f6e-a231-322536dc7c66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:19:17 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52f5581-94ce-421d-ac91-0f00f8413105]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96] added
Nov 14 19:19:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e7305a-425e-4af4-86a0-1e4c5d5b02f1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[647b4bfc-3b7c-4481-a91b-c2344e6a67df]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpBCfcvL {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpBCfcvL" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5430636-3e80-44d6-aaa7-3872ed2f90b3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XpBCfcvL'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5338f6a8-a11c-413a-8500-6d1efccdc81b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a50cd8-0296-42cf-b752-79cdad9c7549]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[10149e98-76e5-4eb8-b068-f33fd4b26736]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]
Nov 14 19:19:18 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.
Nov 14 19:19:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f036d0a0-fe40-4fc9-b967-11e514dd2d4f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1134a664-dbb8-4b65-ac16-4244b5ba7a32]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:18 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[442955cf-5b8f-41f4-b4ff-8854bcb42d74]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 186646528 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] <== connect_volume: return (2601ms) {'type': 'block', 'scsi_wwn': '23233373137323234', 'path': '/dev/sdg'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233373137323234', 'path': '/dev/sdg'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1772840421',display_name='tempest-ServerActionsTestOtherB-server-1772840421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1772840421',id=19,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUvKLnxFaWKfqQ4S/vwP+KIMyYqWAdaytSw3dniXzUF4xEGN7HlZuv7hGHWqxL9ir7W3jD5e9NmeSnZ82sU02gBYwBF2DuOPl6Jkk6gX2AGI1xcTXp5bR0/Q/rxf2ub4A==',key_name='tempest-keypair-444037287',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41ef713467204951b8d5433d80805441',ramdisk_id='',reservation_id='r-5k36qfa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-938366899',owner_user_name='tempest-ServerActionsTestOtherB-938366899-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:19:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614f7aa49ee045c1a3cd9d23cb6bdebe',uuid=c7744d82-c045-4602-9d7a-83f7d331a77e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converting VIF {"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:19:19 user nova-compute[75205]:   <uuid>c7744d82-c045-4602-9d7a-83f7d331a77e</uuid>
Nov 14 19:19:19 user nova-compute[75205]:   <name>instance-00000013</name>
Nov 14 19:19:19 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:19:19 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:19:19 user nova-compute[75205]:   <metadata>
Nov 14 19:19:19 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:19:19 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:19:19 user nova-compute[75205]:       <nova:name>tempest-ServerActionsTestOtherB-server-1772840421</nova:name>
Nov 14 19:19:19 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:19:16</nova:creationTime>
Nov 14 19:19:19 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:19:19 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:19:19 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:19:19 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:19:19 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:19:19 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:19:19 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:19:19 user nova-compute[75205]:       <nova:owner>
Nov 14 19:19:19 user nova-compute[75205]:         <nova:user uuid="614f7aa49ee045c1a3cd9d23cb6bdebe">tempest-ServerActionsTestOtherB-938366899-project-member</nova:user>
Nov 14 19:19:19 user nova-compute[75205]:         <nova:project uuid="41ef713467204951b8d5433d80805441">tempest-ServerActionsTestOtherB-938366899</nova:project>
Nov 14 19:19:19 user nova-compute[75205]:       </nova:owner>
Nov 14 19:19:19 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:19:19 user nova-compute[75205]:       <nova:ports>
Nov 14 19:19:19 user nova-compute[75205]:         <nova:port uuid="814f09b6-754e-4e78-947a-6a7c488019e0">
Nov 14 19:19:19 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 19:19:19 user nova-compute[75205]:         </nova:port>
Nov 14 19:19:19 user nova-compute[75205]:       </nova:ports>
Nov 14 19:19:19 user nova-compute[75205]:     </nova:instance>
Nov 14 19:19:19 user nova-compute[75205]:   </metadata>
Nov 14 19:19:19 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:19:19 user nova-compute[75205]:     <system>
Nov 14 19:19:19 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:19:19 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:19:19 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:19:19 user nova-compute[75205]:       <entry name="serial">c7744d82-c045-4602-9d7a-83f7d331a77e</entry>
Nov 14 19:19:19 user nova-compute[75205]:       <entry name="uuid">c7744d82-c045-4602-9d7a-83f7d331a77e</entry>
Nov 14 19:19:19 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:19:19 user nova-compute[75205]:     </system>
Nov 14 19:19:19 user nova-compute[75205]:   </sysinfo>
Nov 14 19:19:19 user nova-compute[75205]:   <os>
Nov 14 19:19:19 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:19:19 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:19:19 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:19:19 user nova-compute[75205]:   </os>
Nov 14 19:19:19 user nova-compute[75205]:   <features>
Nov 14 19:19:19 user nova-compute[75205]:     <acpi/>
Nov 14 19:19:19 user nova-compute[75205]:     <apic/>
Nov 14 19:19:19 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:19:19 user nova-compute[75205]:   </features>
Nov 14 19:19:19 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:19:19 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:19:19 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:19:19 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:19:19 user nova-compute[75205]:   </clock>
Nov 14 19:19:19 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:19:19 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:19:19 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:19:19 user nova-compute[75205]:   </cpu>
Nov 14 19:19:19 user nova-compute[75205]:   <devices>
Nov 14 19:19:19 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:19:19 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:19:19 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk"/>
Nov 14 19:19:19 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:19:19 user nova-compute[75205]:     </disk>
Nov 14 19:19:19 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:19:19 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:19:19 user nova-compute[75205]:       <source dev="/dev/sdg"/>
Nov 14 19:19:19 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:19:19 user nova-compute[75205]:       <serial>e61131b2-12a0-4593-85bd-155d9fcc8c96</serial>
Nov 14 19:19:19 user nova-compute[75205]:     </disk>
Nov 14 19:19:19 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:19:19 user nova-compute[75205]:       <mac address="fa:16:3e:c6:53:01"/>
Nov 14 19:19:19 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:19:19 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:19:19 user nova-compute[75205]:       <target dev="tap814f09b6-75"/>
Nov 14 19:19:19 user nova-compute[75205]:     </interface>
Nov 14 19:19:19 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:19:19 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/console.log" append="off"/>
Nov 14 19:19:19 user nova-compute[75205]:     </serial>
Nov 14 19:19:19 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:19:19 user nova-compute[75205]:     <video>
Nov 14 19:19:19 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:19:19 user nova-compute[75205]:     </video>
Nov 14 19:19:19 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:19:19 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:19:19 user nova-compute[75205]:     </rng>
Nov 14 19:19:19 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:19:19 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:19:19 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:19:19 user nova-compute[75205]:     </memballoon>
Nov 14 19:19:19 user nova-compute[75205]:   </devices>
Nov 14 19:19:19 user nova-compute[75205]: </domain>
Nov 14 19:19:19 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1772840421',display_name='tempest-ServerActionsTestOtherB-server-1772840421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1772840421',id=19,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUvKLnxFaWKfqQ4S/vwP+KIMyYqWAdaytSw3dniXzUF4xEGN7HlZuv7hGHWqxL9ir7W3jD5e9NmeSnZ82sU02gBYwBF2DuOPl6Jkk6gX2AGI1xcTXp5bR0/Q/rxf2ub4A==',key_name='tempest-keypair-444037287',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='41ef713467204951b8d5433d80805441',ramdisk_id='',reservation_id='r-5k36qfa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-938366899',owner_user_name='tempest-ServerActionsTestOtherB-938366899-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:19:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614f7aa49ee045c1a3cd9d23cb6bdebe',uuid=c7744d82-c045-4602-9d7a-83f7d331a77e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converting VIF {"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG os_vif [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c79cea11-da97-55ad-a257-e596651392d7', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 353370112 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap814f09b6-75, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap814f09b6-75, col_values=(('qos', UUID('b92b0941-1fbc-4abe-899b-90ec5746976f')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap814f09b6-75, col_values=(('external_ids', {'iface-id': '814f09b6-754e-4e78-947a-6a7c488019e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:53:01', 'vm-uuid': 'c7744d82-c045-4602-9d7a-83f7d331a77e'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:19:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:19 user nova-compute[75205]: INFO os_vif [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75')
Nov 14 19:19:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 501219328 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:20 user nova-compute[75205]: INFO nova.compute.manager [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Detaching volume 6f0cdbe5-e304-4a66-a8bd-065510523b8a
Nov 14 19:19:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 651165696 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:20 user nova-compute[75205]: INFO nova.virt.block_device [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Attempting to driver detach volume 6f0cdbe5-e304-4a66-a8bd-065510523b8a from mountpoint /dev/vdb
Nov 14 19:19:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Attempting to detach device vdb from instance fa1515bc-fa72-467e-ae09-54908b54fafa from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:19:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:19:20 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:19:20 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:19:20 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:19:20 user nova-compute[75205]:   <serial>6f0cdbe5-e304-4a66-a8bd-065510523b8a</serial>
Nov 14 19:19:20 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:19:20 user nova-compute[75205]: </disk>
Nov 14 19:19:20 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:19:20 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Successfully detached device vdb from instance fa1515bc-fa72-467e-ae09-54908b54fafa from the persistent domain config.
Nov 14 19:19:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa1515bc-fa72-467e-ae09-54908b54fafa from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:19:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:19:20 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:19:20 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:19:20 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:19:20 user nova-compute[75205]:   <serial>6f0cdbe5-e304-4a66-a8bd-065510523b8a</serial>
Nov 14 19:19:20 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:19:20 user nova-compute[75205]: </disk>
Nov 14 19:19:20 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:19:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 807403520 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-a7083b57-1fd4-4946-a10d-1c0be4eaa525 req-653ae40e-7158-4f14-99d2-f631c7004d85 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a7083b57-1fd4-4946-a10d-1c0be4eaa525 req-653ae40e-7158-4f14-99d2-f631c7004d85 service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a7083b57-1fd4-4946-a10d-1c0be4eaa525 req-653ae40e-7158-4f14-99d2-f631c7004d85 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a7083b57-1fd4-4946-a10d-1c0be4eaa525 req-653ae40e-7158-4f14-99d2-f631c7004d85 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-a7083b57-1fd4-4946-a10d-1c0be4eaa525 req-653ae40e-7158-4f14-99d2-f631c7004d85 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:19:21 user nova-compute[75205]: WARNING nova.compute.manager [req-a7083b57-1fd4-4946-a10d-1c0be4eaa525 req-653ae40e-7158-4f14-99d2-f631c7004d85 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state resized and task_state resize_reverting.
Nov 14 19:19:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa1515bc-fa72-467e-ae09-54908b54fafa {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 976224256 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75205) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNxupoZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '5359d0c8-5799-4388-a714-fb771cfc6d6b'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:22 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[550ce8c3-b0c2-44cb-b048-c99efd1eae45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:19:22 user nova-compute[75205]: No targets found.
Nov 14 19:19:22 user nova-compute[75205]: iSNS:
Nov 14 19:19:22 user nova-compute[75205]: No targets found.
Nov 14 19:19:22 user nova-compute[75205]: STATIC:
Nov 14 19:19:22 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a
Nov 14 19:19:22 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:22 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:22 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b
Nov 14 19:19:22 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:22 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:22 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa
Nov 14 19:19:22 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:22 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:22 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:19:22 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:22 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:22 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a
Nov 14 19:19:22 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:22 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:22 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:19:22 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:22 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:22 user nova-compute[75205]: FIRMWARE:
Nov 14 19:19:22 user nova-compute[75205]: No targets found.
Nov 14 19:19:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:19:22 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:19:22 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe8254e-77f4-4d4b-90f8-d43c86dd8c80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[528dea61-c8f4-4b9f-b74a-824480eadab1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:22 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:22 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:22 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:22 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:22 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:22 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:22 user nova-compute[75205]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b (non-flash)
Nov 14 19:19:22 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:22 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:22 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7461bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b'): ({'sdf'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Removing single pathed devices sdf {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c406a45b-35dd-4d93-8d49-f6b45a118766]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0674e6-ef01-4831-871d-cd87c28d3ae1]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Flushing IO for device /dev/sdf {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3299da-dbff-492d-9be5-ea035c69d2be]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f501a41-744b-4e45-8843-9ba9378b59e9]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] SCSI volumes sdf have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48ce1ea-5570-4d2f-9b9f-04ea09c6c9d2]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49190de-7e98-453e-84fb-30cbdcd2e1fa]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b, portal: 172.16.0.220,3260]
Nov 14 19:19:22 user nova-compute[75205]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b, portal: 172.16.0.220,3260] successful.
Nov 14 19:19:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5359d0c8-5799-4388-a714-fb771cfc6d6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f444729-28ef-4c38-a176-b0334498e08c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] <== disconnect_volume: return (334ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecCfFIzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3c53f075-6a96-4961-a89f-a5afffe1711f', 'attached_at': '', 'detached_at': '', 'volume_id': '1c5cf31b-254a-4476-8e80-6f75078710fa', 'serial'} {{(pid=75205) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 19:19:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] swap_volume: removing Cinder connection for volume 5359d0c8-5799-4388-a714-fb771cfc6d6b {{(pid=75205) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 19:19:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-fddba6be-eec0-4352-8686-55b7fee504bb req-fd161091-00ea-4da0-a102-9d12544d06bb service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:19:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fddba6be-eec0-4352-8686-55b7fee504bb req-fd161091-00ea-4da0-a102-9d12544d06bb service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fddba6be-eec0-4352-8686-55b7fee504bb req-fd161091-00ea-4da0-a102-9d12544d06bb service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fddba6be-eec0-4352-8686-55b7fee504bb req-fd161091-00ea-4da0-a102-9d12544d06bb service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-fddba6be-eec0-4352-8686-55b7fee504bb req-fd161091-00ea-4da0-a102-9d12544d06bb service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:19:23 user nova-compute[75205]: WARNING nova.compute.manager [req-fddba6be-eec0-4352-8686-55b7fee504bb req-fd161091-00ea-4da0-a102-9d12544d06bb service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state resized and task_state resize_reverting.
Nov 14 19:19:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] swap_volume: Updating volume 5359d0c8-5799-4388-a714-fb771cfc6d6b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ecCfFIzV", "auth_password": "oQI3k5fbt4njqE", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "1c5cf31b-254a-4476-8e80-6f75078710fa"}, "status": "reserved", "instance": "3c53f075-6a96-4961-a89f-a5afffe1711f", "attached_at": "", "detached_at": "", "volume_id": "1c5cf31b-254a-4476-8e80-6f75078710fa", "serial": "1c5cf31b-254a-4476-8e80-6f75078710fa"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1c5cf31b-254a-4476-8e80-6f75078710fa', 'no_device': None, 'attachment_id': 'f8f2e4cb-97cb-4df8-a889-9dd08bccdcc6'} {{(pid=75205) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 19:19:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01b4c521-4a5c-45b0-aefd-c4637ad7d0da tempest-TestVolumeSwap-1511101097 tempest-TestVolumeSwap-1511101097-project-admin] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.715s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:19:23 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance running successfully.
Nov 14 19:19:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] finish_revert_migration finished successfully. {{(pid=75205) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 19:19:23 user nova-compute[75205]: INFO nova.compute.manager [None req-9ea32a92-3e75-4000-88b2-d6592186ac85 tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating instance to original state: 'active'
Nov 14 19:19:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:23 user nova-compute[75205]: INFO nova.compute.manager [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Detaching volume 1c5cf31b-254a-4476-8e80-6f75078710fa
Nov 14 19:19:24 user nova-compute[75205]: INFO nova.virt.block_device [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Attempting to driver detach volume 1c5cf31b-254a-4476-8e80-6f75078710fa from mountpoint /dev/vdb
Nov 14 19:19:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Attempting to detach device vdb from instance 3c53f075-6a96-4961-a89f-a5afffe1711f from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:19:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:19:24 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:19:24 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:19:24 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:19:24 user nova-compute[75205]:   <serial>1c5cf31b-254a-4476-8e80-6f75078710fa</serial>
Nov 14 19:19:24 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:19:24 user nova-compute[75205]: </disk>
Nov 14 19:19:24 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:19:24 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Successfully detached device vdb from instance 3c53f075-6a96-4961-a89f-a5afffe1711f from the persistent domain config.
Nov 14 19:19:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c53f075-6a96-4961-a89f-a5afffe1711f from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:19:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:19:24 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:19:24 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:19:24 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:19:24 user nova-compute[75205]:   <serial>1c5cf31b-254a-4476-8e80-6f75078710fa</serial>
Nov 14 19:19:24 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:19:24 user nova-compute[75205]: </disk>
Nov 14 19:19:24 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:19:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c53f075-6a96-4961-a89f-a5afffe1711f {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:19:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:28 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:19:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:19:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:19:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating instance_info_cache with network_info: [{"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-c7744d82-c045-4602-9d7a-83f7d331a77e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75205) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "d1a77658-d712-402d-b67b-322751e2f202" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d1a77658-d712-402d-b67b-322751e2f202" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:19:30 user nova-compute[75205]: INFO nova.compute.claims [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Claim successful on node user
Nov 14 19:19:31 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 87a00d85-b082-4f6e-8869-987e01a91fa0 is timed out.
Nov 14 19:19:31 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Successfully detached device vdb from instance 87a00d85-b082-4f6e-8869-987e01a91fa0 from the live domain config.
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHiBQePG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:31 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a05e59f-2a01-48f5-81f6-4c5c59a0fa4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:19:31 user nova-compute[75205]: No targets found.
Nov 14 19:19:31 user nova-compute[75205]: iSNS:
Nov 14 19:19:31 user nova-compute[75205]: No targets found.
Nov 14 19:19:31 user nova-compute[75205]: STATIC:
Nov 14 19:19:31 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a
Nov 14 19:19:31 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:31 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:31 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa
Nov 14 19:19:31 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:31 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:31 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:19:31 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:31 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:31 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a
Nov 14 19:19:31 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:31 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:31 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:19:31 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:31 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:31 user nova-compute[75205]: FIRMWARE:
Nov 14 19:19:31 user nova-compute[75205]: No targets found.
Nov 14 19:19:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:19:31 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:19:31 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aadc087-97a9-4c23-aa74-1277f8fb6e80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b9ae37-1709-4c14-b146-84039f25a38c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:31 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:31 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:31 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:31 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:31 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:31 user nova-compute[75205]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a (non-flash)
Nov 14 19:19:31 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:31 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb5478ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d13e1f-8593-48c9-8ffb-f73a618f1611]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f270c5f-ff34-4da2-951f-c52246b03d77]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[62194bff-02ed-4d87-b27d-9a6aa3de9efd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[71511085-d3dc-4198-825d-33d0fcfd225d]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[329dd398-b81c-4e9a-8080-dd3141a3b5ed]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8186478-5f00-4ed7-a694-58d52251a016]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a, portal: 172.16.0.220,3260]
Nov 14 19:19:31 user nova-compute[75205]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a, portal: 172.16.0.220,3260] successful.
Nov 14 19:19:31 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c809a8-de91-4ed0-889a-4356154ff90a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b991a88a-a9c8-4088-8a49-f6a7dec8546c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] <== disconnect_volume: return (340ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.656s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:19:31 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.policy [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06b3b7a0f2ae441f8cb1d50891fcab94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fe039dc34949509e4ad72cd9da3bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:19:31 user nova-compute[75205]: INFO nova.virt.block_device [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Booting with volume a5087c09-42c8-40e4-9a60-d499d9cb706d at /dev/vda
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.utils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a8bc02-6a40-422b-857b-b90a3c4716de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef70a5-6ca6-47c3-9aed-706113369413]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83ab540-0517-444c-86b4-5d6a700a5562]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fe9ee7-4b6e-45b8-8bd1-50aa57a6163b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:19:31 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aac40d-da8a-4839-bae0-557399f4a753]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG os_brick.utils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Updating existing volume attachment record: d47aaab3-997a-4972-a5d7-70ed57402c72 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Successfully created port: 05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Successfully updated port: 05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "refresh_cache-d1a77658-d712-402d-b67b-322751e2f202" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquired lock "refresh_cache-d1a77658-d712-402d-b67b-322751e2f202" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-5cee9984-0851-4eff-988f-dad10c6a576f req-25f85375-9f66-4271-8a09-bf1310db5028 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received event network-changed-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-5cee9984-0851-4eff-988f-dad10c6a576f req-25f85375-9f66-4271-8a09-bf1310db5028 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Refreshing instance network info cache due to event network-changed-05de1606-06bb-42c1-89f0-0e6d3bdb7812. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:19:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5cee9984-0851-4eff-988f-dad10c6a576f req-25f85375-9f66-4271-8a09-bf1310db5028 service nova] Acquiring lock "refresh_cache-d1a77658-d712-402d-b67b-322751e2f202" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG nova.network.neutron [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Updating instance_info_cache with network_info: [{"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Releasing lock "refresh_cache-d1a77658-d712-402d-b67b-322751e2f202" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Instance network_info: |[{"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5cee9984-0851-4eff-988f-dad10c6a576f req-25f85375-9f66-4271-8a09-bf1310db5028 service nova] Acquired lock "refresh_cache-d1a77658-d712-402d-b67b-322751e2f202" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG nova.network.neutron [req-5cee9984-0851-4eff-988f-dad10c6a576f req-25f85375-9f66-4271-8a09-bf1310db5028 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Refreshing network info cache for port 05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG nova.network.neutron [req-5cee9984-0851-4eff-988f-dad10c6a576f req-25f85375-9f66-4271-8a09-bf1310db5028 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Updated VIF entry in instance network info cache for port 05de1606-06bb-42c1-89f0-0e6d3bdb7812. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG nova.network.neutron [req-5cee9984-0851-4eff-988f-dad10c6a576f req-25f85375-9f66-4271-8a09-bf1310db5028 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Updating instance_info_cache with network_info: [{"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5cee9984-0851-4eff-988f-dad10c6a576f req-25f85375-9f66-4271-8a09-bf1310db5028 service nova] Releasing lock "refresh_cache-d1a77658-d712-402d-b67b-322751e2f202" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:36 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:19:36 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:19:36 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7164MB free_disk=24.904720306396484GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:19:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6864c442-8284-4dd8-8165-ff891e5d5175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance fa1515bc-fa72-467e-ae09-54908b54fafa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3c53f075-6a96-4961-a89f-a5afffe1711f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2a32bb26-deb4-407d-a9e9-31de887e0b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 87a00d85-b082-4f6e-8869-987e01a91fa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance c7744d82-c045-4602-9d7a-83f7d331a77e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d1a77658-d712-402d-b67b-322751e2f202 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 19:19:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] There are 0 instances to clean {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 19:19:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:41 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fa1515bc-fa72-467e-ae09-54908b54fafa is timed out.
Nov 14 19:19:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Successfully detached device vdb from instance fa1515bc-fa72-467e-ae09-54908b54fafa from the live domain config.
Nov 14 19:19:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaWZtmuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:41 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[716fd2f7-80e6-42c1-a28f-1123a994ecab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:19:41 user nova-compute[75205]: No targets found.
Nov 14 19:19:41 user nova-compute[75205]: iSNS:
Nov 14 19:19:41 user nova-compute[75205]: No targets found.
Nov 14 19:19:41 user nova-compute[75205]: STATIC:
Nov 14 19:19:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a
Nov 14 19:19:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa
Nov 14 19:19:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:19:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:19:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:41 user nova-compute[75205]: FIRMWARE:
Nov 14 19:19:41 user nova-compute[75205]: No targets found.
Nov 14 19:19:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:19:41 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:19:41 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a97d1ba-aace-4b78-b06d-2a20f71e211c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f140cd77-52fd-4b0d-be1e-b66211f5ca98]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:41 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:41 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:41 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:41 user nova-compute[75205]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a (non-flash)
Nov 14 19:19:41 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:41 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb741080d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a'): ({'sdd'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Removing single pathed devices sdd {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc990e6a-366e-4b4b-8503-d613a25bab5a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaff79dc-1287-4f4c-8cd3-74200f057055]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Flushing IO for device /dev/sdd {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d13aa71-2318-42a3-a0ae-ed2e21e8499b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadb875c-2d2f-454a-85cf-1c5527f10748]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6643140-98ec-417a-9287-ed4380f7fdae]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b2e619-7567-4b2f-b377-d26a932be1a2]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a, portal: 172.16.0.220,3260]
Nov 14 19:19:41 user nova-compute[75205]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a, portal: 172.16.0.220,3260] successful.
Nov 14 19:19:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0cdbe5-e304-4a66-a8bd-065510523b8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b1e0e6-6dfd-4207-a73e-6148b8ae6650]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] <== disconnect_volume: return (336ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:19:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:44 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3c53f075-6a96-4961-a89f-a5afffe1711f is timed out.
Nov 14 19:19:44 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Successfully detached device vdb from instance 3c53f075-6a96-4961-a89f-a5afffe1711f from the live domain config.
Nov 14 19:19:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecCfFIzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '1c5cf31b-254a-4476-8e80-6f75078710fa'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:19:44 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4da891-f68b-4a49-a3cf-a277a00d9cf5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:19:44 user nova-compute[75205]: No targets found.
Nov 14 19:19:44 user nova-compute[75205]: iSNS:
Nov 14 19:19:44 user nova-compute[75205]: No targets found.
Nov 14 19:19:44 user nova-compute[75205]: STATIC:
Nov 14 19:19:44 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa
Nov 14 19:19:44 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:44 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:44 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:19:44 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:44 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:44 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:19:44 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:19:44 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:19:44 user nova-compute[75205]: FIRMWARE:
Nov 14 19:19:44 user nova-compute[75205]: No targets found.
Nov 14 19:19:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:19:44 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:19:44 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[067a63e8-26a9-4853-b0a5-c779ef6ae887]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9378f6d-b337-4173-a010-8e6887175092]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:44 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:44 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:19:44 user nova-compute[75205]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa (non-flash)
Nov 14 19:19:44 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:19:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb74626830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa'): ({'sde'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Removing single pathed devices sde {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4518c91-acd1-4b45-9684-3ed2c9421337]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[181c6599-d7d6-4558-916e-b8af7d00ab13]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Flushing IO for device /dev/sde {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e103f-372a-464f-a3b3-c58cf55c2a0b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49a3efc-71d1-4d6b-beb9-0d03a59cdeb8]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[50549ca2-6b03-40e4-8f33-6844b6933e15]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[847a97a2-defb-4435-90e3-1134cbbb54db]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260]
Nov 14 19:19:44 user nova-compute[75205]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa, portal: 172.16.0.220,3260] successful.
Nov 14 19:19:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c5cf31b-254a-4476-8e80-6f75078710fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a2cf14-8196-4062-a621-54f717017211]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] <== disconnect_volume: return (277ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:19:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:19:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:19:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:19:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:19:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:19:52 user nova-compute[75205]: INFO nova.compute.claims [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Claim successful on node user
Nov 14 19:19:53 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:19:53 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:19:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:19:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:19:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:19:53 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:19:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:19:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:19:53 user nova-compute[75205]: DEBUG nova.policy [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0ee9d2093e64175b45b3b4d99b5648f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde587867310451cab4f464b330555af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:19:53 user nova-compute[75205]: INFO nova.virt.block_device [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Booting with volume-backed-image 992ee33c-41f8-4ea7-bc15-8d73f5a51f6d at /dev/vda
Nov 14 19:19:53 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Successfully created port: ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Successfully updated port: ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquired lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG nova.compute.manager [req-35e2df04-8f13-4ab9-b851-7cdcad72c093 req-0ef5a9e8-c6bd-4cff-a05c-7921fc087cf5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-changed-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG nova.compute.manager [req-35e2df04-8f13-4ab9-b851-7cdcad72c093 req-0ef5a9e8-c6bd-4cff-a05c-7921fc087cf5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Refreshing instance network info cache due to event network-changed-ad5f1ef2-ebe2-4f5f-8777-891848473af2. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35e2df04-8f13-4ab9-b851-7cdcad72c093 req-0ef5a9e8-c6bd-4cff-a05c-7921fc087cf5 service nova] Acquiring lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Updating instance_info_cache with network_info: [{"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Releasing lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Instance network_info: |[{"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35e2df04-8f13-4ab9-b851-7cdcad72c093 req-0ef5a9e8-c6bd-4cff-a05c-7921fc087cf5 service nova] Acquired lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:19:54 user nova-compute[75205]: DEBUG nova.network.neutron [req-35e2df04-8f13-4ab9-b851-7cdcad72c093 req-0ef5a9e8-c6bd-4cff-a05c-7921fc087cf5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Refreshing network info cache for port ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:19:55 user nova-compute[75205]: DEBUG nova.network.neutron [req-35e2df04-8f13-4ab9-b851-7cdcad72c093 req-0ef5a9e8-c6bd-4cff-a05c-7921fc087cf5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Updated VIF entry in instance network info cache for port ad5f1ef2-ebe2-4f5f-8777-891848473af2. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:19:55 user nova-compute[75205]: DEBUG nova.network.neutron [req-35e2df04-8f13-4ab9-b851-7cdcad72c093 req-0ef5a9e8-c6bd-4cff-a05c-7921fc087cf5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Updating instance_info_cache with network_info: [{"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:19:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35e2df04-8f13-4ab9-b851-7cdcad72c093 req-0ef5a9e8-c6bd-4cff-a05c-7921fc087cf5 service nova] Releasing lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:19:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:19:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:19:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:19:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:19:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:19:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:03 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lazy-loading 'flavor' on Instance uuid 87a00d85-b082-4f6e-8869-987e01a91fa0 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bc07f36-1e42-4c2e-9a20-c373263fe71a tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 53.117s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:03 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lazy-loading 'flavor' on Instance uuid fa1515bc-fa72-467e-ae09-54908b54fafa {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cd483b71-17e2-40e5-9fad-8340a8d012b4 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 43.533s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:04 user nova-compute[75205]: DEBUG nova.objects.instance [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lazy-loading 'flavor' on Instance uuid 3c53f075-6a96-4961-a89f-a5afffe1711f {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-323a94c0-80ec-4068-a6c2-b5edf159995b tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 40.408s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:20:07 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Creating image(s)
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Ensure instance console log exists: /opt/stack/data/nova/instances/d1a77658-d712-402d-b67b-322751e2f202/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Start _get_guest_xml network_info=[{"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIOvhEeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1a77658-d712-402d-b67b-322751e2f202', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5087c09-42c8-40e4-9a60-d499d9cb706d', 'serial': 'a5087c09-42c8-40e4-9a60-d499d9cb706d'}, 'attachment_id': 'd47aaab3-997a-4972-a5d7-70ed57402c72', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:20:07 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:20:07 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIOvhEeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:07 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:07 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:07 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b9366-d444-45d2-bfe8-3bac1e676627]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:20:07 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1d0b6d-310c-4b63-8d72-e5f63a7359a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d] added
Nov 14 19:20:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[377da67c-d7be-43f6-8753-bd713b439bbf]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a472d99e-4952-408d-82b5-6df6650e8b07]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIOvhEeC {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIOvhEeC" returned: 0 in 0.032s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4e9de0-8e8a-4ea8-a6a4-26af1f492122]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kIOvhEeC'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e184cb9-3255-4e52-adb3-c3a84bb2dc46]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[529b8dda-b8a7-4daf-9ed5-d5fa00269b18]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:07 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:07 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[53611011-3d5e-4775-9f0c-7ff388593a2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d, portal: 172.16.0.220,3260]
Nov 14 19:20:08 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d, portal: 172.16.0.220,3260] successful.
Nov 14 19:20:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[439a3fe3-1ebe-43b0-a0ce-8a4a477262d4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5890a161-745f-49aa-b1d3-8111260ad74e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:08 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:08 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:08 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:08 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2505ecc-075d-4c8f-bacb-12400a686edb]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:20:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIOvhEeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23035386163613135', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035386163613135', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:19:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1821458419',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1821458419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1821458419',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGFWw0BmGhBPPz35ZLdiBa1JKOX310idLb8FbKN+OmSGJoG8ylMI0J6aR8LEEzvuQGi37s+Bb6dOUWK8NklcEubwpRB16+bfPZNITKNnhqho9m0eU13uZ4YikE+WXJMqQ==',key_name='tempest-keypair-441669733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-97hax086',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:19:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=d1a77658-d712-402d-b67b-322751e2f202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:be:43,bridge_name='br-int',has_traffic_filtering=True,id=05de1606-06bb-42c1-89f0-0e6d3bdb7812,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05de1606-06') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'pci_devices' on Instance uuid d1a77658-d712-402d-b67b-322751e2f202 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:20:09 user nova-compute[75205]:   <uuid>d1a77658-d712-402d-b67b-322751e2f202</uuid>
Nov 14 19:20:09 user nova-compute[75205]:   <name>instance-0000001e</name>
Nov 14 19:20:09 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:20:09 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:20:09 user nova-compute[75205]:   <metadata>
Nov 14 19:20:09 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:20:09 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:20:09 user nova-compute[75205]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1821458419</nova:name>
Nov 14 19:20:09 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:20:07</nova:creationTime>
Nov 14 19:20:09 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:20:09 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:20:09 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:20:09 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:20:09 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:20:09 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:20:09 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:20:09 user nova-compute[75205]:       <nova:owner>
Nov 14 19:20:09 user nova-compute[75205]:         <nova:user uuid="06b3b7a0f2ae441f8cb1d50891fcab94">tempest-TestVolumeBootPattern-397278786-project-member</nova:user>
Nov 14 19:20:09 user nova-compute[75205]:         <nova:project uuid="e2fe039dc34949509e4ad72cd9da3bf1">tempest-TestVolumeBootPattern-397278786</nova:project>
Nov 14 19:20:09 user nova-compute[75205]:       </nova:owner>
Nov 14 19:20:09 user nova-compute[75205]:       <nova:ports>
Nov 14 19:20:09 user nova-compute[75205]:         <nova:port uuid="05de1606-06bb-42c1-89f0-0e6d3bdb7812">
Nov 14 19:20:09 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 19:20:09 user nova-compute[75205]:         </nova:port>
Nov 14 19:20:09 user nova-compute[75205]:       </nova:ports>
Nov 14 19:20:09 user nova-compute[75205]:     </nova:instance>
Nov 14 19:20:09 user nova-compute[75205]:   </metadata>
Nov 14 19:20:09 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:20:09 user nova-compute[75205]:     <system>
Nov 14 19:20:09 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:20:09 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:20:09 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:20:09 user nova-compute[75205]:       <entry name="serial">d1a77658-d712-402d-b67b-322751e2f202</entry>
Nov 14 19:20:09 user nova-compute[75205]:       <entry name="uuid">d1a77658-d712-402d-b67b-322751e2f202</entry>
Nov 14 19:20:09 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:20:09 user nova-compute[75205]:     </system>
Nov 14 19:20:09 user nova-compute[75205]:   </sysinfo>
Nov 14 19:20:09 user nova-compute[75205]:   <os>
Nov 14 19:20:09 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:20:09 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:20:09 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:20:09 user nova-compute[75205]:   </os>
Nov 14 19:20:09 user nova-compute[75205]:   <features>
Nov 14 19:20:09 user nova-compute[75205]:     <acpi/>
Nov 14 19:20:09 user nova-compute[75205]:     <apic/>
Nov 14 19:20:09 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:20:09 user nova-compute[75205]:   </features>
Nov 14 19:20:09 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:20:09 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:20:09 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:20:09 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:20:09 user nova-compute[75205]:   </clock>
Nov 14 19:20:09 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:20:09 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:20:09 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:20:09 user nova-compute[75205]:   </cpu>
Nov 14 19:20:09 user nova-compute[75205]:   <devices>
Nov 14 19:20:09 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:20:09 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:20:09 user nova-compute[75205]:       <source dev="/dev/sdc"/>
Nov 14 19:20:09 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:20:09 user nova-compute[75205]:       <serial>a5087c09-42c8-40e4-9a60-d499d9cb706d</serial>
Nov 14 19:20:09 user nova-compute[75205]:     </disk>
Nov 14 19:20:09 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:20:09 user nova-compute[75205]:       <mac address="fa:16:3e:ce:be:43"/>
Nov 14 19:20:09 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:20:09 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:20:09 user nova-compute[75205]:       <target dev="tap05de1606-06"/>
Nov 14 19:20:09 user nova-compute[75205]:     </interface>
Nov 14 19:20:09 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:20:09 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/d1a77658-d712-402d-b67b-322751e2f202/console.log" append="off"/>
Nov 14 19:20:09 user nova-compute[75205]:     </serial>
Nov 14 19:20:09 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:20:09 user nova-compute[75205]:     <video>
Nov 14 19:20:09 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:20:09 user nova-compute[75205]:     </video>
Nov 14 19:20:09 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:20:09 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:20:09 user nova-compute[75205]:     </rng>
Nov 14 19:20:09 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:20:09 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:20:09 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:20:09 user nova-compute[75205]:     </memballoon>
Nov 14 19:20:09 user nova-compute[75205]:   </devices>
Nov 14 19:20:09 user nova-compute[75205]: </domain>
Nov 14 19:20:09 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:19:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1821458419',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1821458419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1821458419',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGFWw0BmGhBPPz35ZLdiBa1JKOX310idLb8FbKN+OmSGJoG8ylMI0J6aR8LEEzvuQGi37s+Bb6dOUWK8NklcEubwpRB16+bfPZNITKNnhqho9m0eU13uZ4YikE+WXJMqQ==',key_name='tempest-keypair-441669733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-97hax086',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:19:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=d1a77658-d712-402d-b67b-322751e2f202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:be:43,bridge_name='br-int',has_traffic_filtering=True,id=05de1606-06bb-42c1-89f0-0e6d3bdb7812,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05de1606-06') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG os_vif [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:be:43,bridge_name='br-int',has_traffic_filtering=True,id=05de1606-06bb-42c1-89f0-0e6d3bdb7812,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05de1606-06') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e849d632-801f-5ec0-9332-897e5027b9d9', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05de1606-06, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05de1606-06, col_values=(('qos', UUID('002b762a-c171-45c4-a2d2-ed639f4b820b')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05de1606-06, col_values=(('external_ids', {'iface-id': '05de1606-06bb-42c1-89f0-0e6d3bdb7812', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:be:43', 'vm-uuid': 'd1a77658-d712-402d-b67b-322751e2f202'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:09 user nova-compute[75205]: INFO os_vif [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:be:43,bridge_name='br-int',has_traffic_filtering=True,id=05de1606-06bb-42c1-89f0-0e6d3bdb7812,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05de1606-06')
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No VIF found with MAC fa:16:3e:ce:be:43, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG os_brick.utils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29dd333-5807-4408-b494-72f4d9361b85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a40154d-7ba7-4d7f-9fdc-39cb8edb357c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f02a8b-4937-4b5b-a44e-703cf518d0d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae573b19-fdab-431e-9691-887ccabcd8b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:20:09 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:20:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9046b346-b79d-413e-9c62-71b00c406799]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG os_brick.utils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:09 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Updating existing volume attachment record: aa836143-bae7-4eed-bf04-332eba26536a {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:10 user nova-compute[75205]: INFO nova.compute.manager [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Terminating instance
Nov 14 19:20:10 user nova-compute[75205]: DEBUG nova.compute.manager [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-afe9fe55-9558-4d6a-9bb3-e2f639235c9c req-52adc4b8-0543-4d89-82ed-2ff342ac4a3f service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received event network-vif-plugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-afe9fe55-9558-4d6a-9bb3-e2f639235c9c req-52adc4b8-0543-4d89-82ed-2ff342ac4a3f service nova] Acquiring lock "d1a77658-d712-402d-b67b-322751e2f202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-afe9fe55-9558-4d6a-9bb3-e2f639235c9c req-52adc4b8-0543-4d89-82ed-2ff342ac4a3f service nova] Lock "d1a77658-d712-402d-b67b-322751e2f202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-afe9fe55-9558-4d6a-9bb3-e2f639235c9c req-52adc4b8-0543-4d89-82ed-2ff342ac4a3f service nova] Lock "d1a77658-d712-402d-b67b-322751e2f202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-afe9fe55-9558-4d6a-9bb3-e2f639235c9c req-52adc4b8-0543-4d89-82ed-2ff342ac4a3f service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] No waiting events found dispatching network-vif-plugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:10 user nova-compute[75205]: WARNING nova.compute.manager [req-afe9fe55-9558-4d6a-9bb3-e2f639235c9c req-52adc4b8-0543-4d89-82ed-2ff342ac4a3f service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received unexpected event network-vif-plugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 for instance with vm_state building and task_state spawning.
Nov 14 19:20:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-8a006aeb-8eed-4522-958b-1cabd87ae766 req-33b0db8d-0215-4412-8b86-73702ee513f3 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received event network-vif-unplugged-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8a006aeb-8eed-4522-958b-1cabd87ae766 req-33b0db8d-0215-4412-8b86-73702ee513f3 service nova] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8a006aeb-8eed-4522-958b-1cabd87ae766 req-33b0db8d-0215-4412-8b86-73702ee513f3 service nova] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8a006aeb-8eed-4522-958b-1cabd87ae766 req-33b0db8d-0215-4412-8b86-73702ee513f3 service nova] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-8a006aeb-8eed-4522-958b-1cabd87ae766 req-33b0db8d-0215-4412-8b86-73702ee513f3 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] No waiting events found dispatching network-vif-unplugged-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-8a006aeb-8eed-4522-958b-1cabd87ae766 req-33b0db8d-0215-4412-8b86-73702ee513f3 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received event network-vif-unplugged-e75f4677-5a08-457c-9625-1c200a6552c3 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Instance destroyed successfully.
Nov 14 19:20:11 user nova-compute[75205]: DEBUG nova.objects.instance [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lazy-loading 'resources' on Instance uuid fa1515bc-fa72-467e-ae09-54908b54fafa {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-523020605',display_name='tempest-TestServerVolumeAttachmentScenario-server-523020605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-523020605',id=23,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPqMVLjpedCDntmjbPrQUX2NJm6Mt16va/HwHe87YWSbXJ+HVktHwxeZk0YPNy3qj/Mh4eMJZkKHrvizHgnlWHGL0uDY68T6XxaUjELblmiX0rWPMuTw5uR7U2Qn7C9Qg==',key_name='tempest-keypair-518937349',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:16:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40b31b366df34fb6a0353eb2226a3fa4',ramdisk_id='',reservation_id='r-urik8j8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1448910620',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1448910620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:16:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='724a5d9855d043079616992e2e038274',uuid=fa1515bc-fa72-467e-ae09-54908b54fafa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Converting VIF {"id": "e75f4677-5a08-457c-9625-1c200a6552c3", "address": "fa:16:3e:cd:60:ae", "network": {"id": "72409e0a-b604-4ba5-9e75-3a4659dacd9d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2005606543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b31b366df34fb6a0353eb2226a3fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75f4677-5a", "ovs_interfaceid": "e75f4677-5a08-457c-9625-1c200a6552c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:60:ae,bridge_name='br-int',has_traffic_filtering=True,id=e75f4677-5a08-457c-9625-1c200a6552c3,network=Network(72409e0a-b604-4ba5-9e75-3a4659dacd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75f4677-5a') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG os_vif [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:60:ae,bridge_name='br-int',has_traffic_filtering=True,id=e75f4677-5a08-457c-9625-1c200a6552c3,network=Network(72409e0a-b604-4ba5-9e75-3a4659dacd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75f4677-5a') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape75f4677-5a, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbf0fa59-0c9d-4c19-be51-e052745e17b6) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:11 user nova-compute[75205]: INFO os_vif [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:60:ae,bridge_name='br-int',has_traffic_filtering=True,id=e75f4677-5a08-457c-9625-1c200a6552c3,network=Network(72409e0a-b604-4ba5-9e75-3a4659dacd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75f4677-5a')
Nov 14 19:20:11 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Deleting instance files /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa_del
Nov 14 19:20:11 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Deletion of /opt/stack/data/nova/instances/fa1515bc-fa72-467e-ae09-54908b54fafa_del complete
Nov 14 19:20:11 user nova-compute[75205]: INFO nova.compute.manager [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 19:20:11 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:20:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:20:12 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Took 0.67 seconds to deallocate network for instance.
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Refreshing inventories for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Updating ProviderTree inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Refreshing aggregate associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, aggregates: None {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Refreshing trait associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, traits: HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:20:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d1a77658-d712-402d-b67b-322751e2f202] Instance spawned successfully.
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:12 user nova-compute[75205]: INFO nova.compute.manager [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-f911eaf2-4ba0-491e-91cb-f87a4916362c req-f0fcdb68-31eb-4c06-9d60-929df561d4b8 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received event network-vif-plugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f911eaf2-4ba0-491e-91cb-f87a4916362c req-f0fcdb68-31eb-4c06-9d60-929df561d4b8 service nova] Acquiring lock "d1a77658-d712-402d-b67b-322751e2f202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f911eaf2-4ba0-491e-91cb-f87a4916362c req-f0fcdb68-31eb-4c06-9d60-929df561d4b8 service nova] Lock "d1a77658-d712-402d-b67b-322751e2f202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f911eaf2-4ba0-491e-91cb-f87a4916362c req-f0fcdb68-31eb-4c06-9d60-929df561d4b8 service nova] Lock "d1a77658-d712-402d-b67b-322751e2f202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-f911eaf2-4ba0-491e-91cb-f87a4916362c req-f0fcdb68-31eb-4c06-9d60-929df561d4b8 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] No waiting events found dispatching network-vif-plugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:12 user nova-compute[75205]: WARNING nova.compute.manager [req-f911eaf2-4ba0-491e-91cb-f87a4916362c req-f0fcdb68-31eb-4c06-9d60-929df561d4b8 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received unexpected event network-vif-plugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 for instance with vm_state building and task_state spawning.
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-f911eaf2-4ba0-491e-91cb-f87a4916362c req-f0fcdb68-31eb-4c06-9d60-929df561d4b8 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received event network-vif-deleted-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:12 user nova-compute[75205]: INFO nova.compute.manager [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Took 42.21 seconds to build instance.
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c7493bb7-cfa0-4b39-b252-fead4e2bde12 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d1a77658-d712-402d-b67b-322751e2f202" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.298s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:12 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Deleted allocations for instance fa1515bc-fa72-467e-ae09-54908b54fafa
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-91730001-9936-46a4-8140-fbf32a3fb902 tempest-TestServerVolumeAttachmentScenario-1448910620 tempest-TestServerVolumeAttachmentScenario-1448910620-project-member] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-6040a61a-51f9-468b-8570-4938c0974b0c req-e900c9d5-5e83-4bc4-8036-d4e99d8d2300 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received event network-vif-plugged-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6040a61a-51f9-468b-8570-4938c0974b0c req-e900c9d5-5e83-4bc4-8036-d4e99d8d2300 service nova] Acquiring lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6040a61a-51f9-468b-8570-4938c0974b0c req-e900c9d5-5e83-4bc4-8036-d4e99d8d2300 service nova] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6040a61a-51f9-468b-8570-4938c0974b0c req-e900c9d5-5e83-4bc4-8036-d4e99d8d2300 service nova] Lock "fa1515bc-fa72-467e-ae09-54908b54fafa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-6040a61a-51f9-468b-8570-4938c0974b0c req-e900c9d5-5e83-4bc4-8036-d4e99d8d2300 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] No waiting events found dispatching network-vif-plugged-e75f4677-5a08-457c-9625-1c200a6552c3 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:12 user nova-compute[75205]: WARNING nova.compute.manager [req-6040a61a-51f9-468b-8570-4938c0974b0c req-e900c9d5-5e83-4bc4-8036-d4e99d8d2300 service nova] [instance: fa1515bc-fa72-467e-ae09-54908b54fafa] Received unexpected event network-vif-plugged-e75f4677-5a08-457c-9625-1c200a6552c3 for instance with vm_state deleted and task_state None.
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:20:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Creating image(s)
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Ensure instance console log exists: /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Start _get_guest_xml network_info=[{"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPxeWdfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ec04cbd-a532-4e15-ba88-a87e6d41e249', 'attached_at': '', 'detached_at': '', 'volume_id': '616c6c6f-cd8b-44fb-8956-d010e71b92e0', 'serial': '616c6c6f-cd8b-44fb-8956-d010e71b92e0'}, 'attachment_id': 'aa836143-bae7-4eed-bf04-332eba26536a', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:20:14 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:20:14 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPxeWdfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:14 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:14 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:14 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: INFO nova.compute.manager [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Terminating instance
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[49249c8c-eea2-4462-82d3-de37becee2a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:20:14 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4830ba95-ed22-4e10-be67-60e5f2c7fcc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0] added
Nov 14 19:20:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[235efa34-f209-485f-8e03-017076182918]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4206e1-be04-4f36-8e15-c37cb85a3ae8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPxeWdfc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPxeWdfc" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc65dfa9-2b54-4529-9585-edff6f9e9514]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPxeWdfc'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.064s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8e6e96-e120-4846-b562-17a57efed0d3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01f9f88-f488-417a-8e9c-98d5057c56d3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:14 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:14 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:14 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:14 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a02f7a6-bba8-48fd-8b0b-9fc1907b3720]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0, portal: 172.16.0.220,3260]
Nov 14 19:20:14 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0, portal: 172.16.0.220,3260] successful.
Nov 14 19:20:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0922e32b-1707-44d3-b9d7-7144567d6a64]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4378b36-8b21-4f25-a890-89486766a736]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:14 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:14 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:14 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:14 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:14 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:14 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e70756c-f598-4651-87f0-edda1d7a15ec]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPxeWdfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received event network-vif-unplugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] No waiting events found dispatching network-vif-unplugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received event network-vif-unplugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received event network-vif-plugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] Acquiring lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] No waiting events found dispatching network-vif-plugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:14 user nova-compute[75205]: WARNING nova.compute.manager [req-3500be84-30b9-4b79-902d-d37b02d2ecaa req-d4442cb4-7644-4453-a4e4-92a6aeee2bfd service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received unexpected event network-vif-plugged-a1c75ae0-844b-4b14-a4d8-77f116a65a6c for instance with vm_state active and task_state deleting.
Nov 14 19:20:15 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Instance destroyed successfully.
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lazy-loading 'resources' on Instance uuid 3c53f075-6a96-4961-a89f-a5afffe1711f {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1799921118',display_name='tempest-TestVolumeSwap-server-1799921118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1799921118',id=25,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7B8MQNjXPa/nDtbI5vDgmTMEtY7WHT4g4k5DJT6EBNYje0rfviySVQDlBRIANnMI74Cv+r9WEOMjkIs2ZFWAbWMgrMOwJOzSMUxMjqCmTmvxfAuMDSJg5afRVgcktSoA==',key_name='tempest-keypair-805392591',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0118c1a2ce88447d8fe121787dc8aead',ramdisk_id='',reservation_id='r-ty1mpo5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-999383946',owner_user_name='tempest-TestVolumeSwap-999383946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1414e772c8ac4c4f8c648cf0a4b7c18d',uuid=3c53f075-6a96-4961-a89f-a5afffe1711f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Converting VIF {"id": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "address": "fa:16:3e:7c:41:70", "network": {"id": "b303a978-bb22-4748-9f4c-745d0ea30639", "bridge": "br-int", "label": "tempest-TestVolumeSwap-780970764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0118c1a2ce88447d8fe121787dc8aead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c75ae0-84", "ovs_interfaceid": "a1c75ae0-844b-4b14-a4d8-77f116a65a6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a1c75ae0-844b-4b14-a4d8-77f116a65a6c,network=Network(b303a978-bb22-4748-9f4c-745d0ea30639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c75ae0-84') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG os_vif [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a1c75ae0-844b-4b14-a4d8-77f116a65a6c,network=Network(b303a978-bb22-4748-9f4c-745d0ea30639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c75ae0-84') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1c75ae0-84, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=389be9ab-c8a0-4793-92af-68db335a4f0e) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:15 user nova-compute[75205]: INFO os_vif [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a1c75ae0-844b-4b14-a4d8-77f116a65a6c,network=Network(b303a978-bb22-4748-9f4c-745d0ea30639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c75ae0-84')
Nov 14 19:20:15 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Deleting instance files /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f_del
Nov 14 19:20:15 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Deletion of /opt/stack/data/nova/instances/3c53f075-6a96-4961-a89f-a5afffe1711f_del complete
Nov 14 19:20:15 user nova-compute[75205]: INFO nova.compute.manager [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 19:20:15 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26436366362376531', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436366362376531', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1344472545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1344472545',id=31,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-rf8l979h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:19:53Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=1ec04cbd-a532-4e15-ba88-a87e6d41e249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:48:58,bridge_name='br-int',has_traffic_filtering=True,id=ad5f1ef2-ebe2-4f5f-8777-891848473af2,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5f1ef2-eb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ec04cbd-a532-4e15-ba88-a87e6d41e249 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:20:15 user nova-compute[75205]:   <uuid>1ec04cbd-a532-4e15-ba88-a87e6d41e249</uuid>
Nov 14 19:20:15 user nova-compute[75205]:   <name>instance-0000001f</name>
Nov 14 19:20:15 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:20:15 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:20:15 user nova-compute[75205]:   <metadata>
Nov 14 19:20:15 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:20:15 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:20:15 user nova-compute[75205]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1344472545</nova:name>
Nov 14 19:20:15 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:20:14</nova:creationTime>
Nov 14 19:20:15 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:20:15 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:20:15 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:20:15 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:20:15 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:20:15 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:20:15 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:20:15 user nova-compute[75205]:       <nova:owner>
Nov 14 19:20:15 user nova-compute[75205]:         <nova:user uuid="d0ee9d2093e64175b45b3b4d99b5648f">tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member</nova:user>
Nov 14 19:20:15 user nova-compute[75205]:         <nova:project uuid="fde587867310451cab4f464b330555af">tempest-ServerBootFromVolumeStableRescueTest-2146587572</nova:project>
Nov 14 19:20:15 user nova-compute[75205]:       </nova:owner>
Nov 14 19:20:15 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:20:15 user nova-compute[75205]:       <nova:ports>
Nov 14 19:20:15 user nova-compute[75205]:         <nova:port uuid="ad5f1ef2-ebe2-4f5f-8777-891848473af2">
Nov 14 19:20:15 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 19:20:15 user nova-compute[75205]:         </nova:port>
Nov 14 19:20:15 user nova-compute[75205]:       </nova:ports>
Nov 14 19:20:15 user nova-compute[75205]:     </nova:instance>
Nov 14 19:20:15 user nova-compute[75205]:   </metadata>
Nov 14 19:20:15 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:20:15 user nova-compute[75205]:     <system>
Nov 14 19:20:15 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:20:15 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:20:15 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:20:15 user nova-compute[75205]:       <entry name="serial">1ec04cbd-a532-4e15-ba88-a87e6d41e249</entry>
Nov 14 19:20:15 user nova-compute[75205]:       <entry name="uuid">1ec04cbd-a532-4e15-ba88-a87e6d41e249</entry>
Nov 14 19:20:15 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:20:15 user nova-compute[75205]:     </system>
Nov 14 19:20:15 user nova-compute[75205]:   </sysinfo>
Nov 14 19:20:15 user nova-compute[75205]:   <os>
Nov 14 19:20:15 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:20:15 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:20:15 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:20:15 user nova-compute[75205]:   </os>
Nov 14 19:20:15 user nova-compute[75205]:   <features>
Nov 14 19:20:15 user nova-compute[75205]:     <acpi/>
Nov 14 19:20:15 user nova-compute[75205]:     <apic/>
Nov 14 19:20:15 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:20:15 user nova-compute[75205]:   </features>
Nov 14 19:20:15 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:20:15 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:20:15 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:20:15 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:20:15 user nova-compute[75205]:   </clock>
Nov 14 19:20:15 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:20:15 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:20:15 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:20:15 user nova-compute[75205]:   </cpu>
Nov 14 19:20:15 user nova-compute[75205]:   <devices>
Nov 14 19:20:15 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:20:15 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:20:15 user nova-compute[75205]:       <source dev="/dev/sdd"/>
Nov 14 19:20:15 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:20:15 user nova-compute[75205]:       <serial>616c6c6f-cd8b-44fb-8956-d010e71b92e0</serial>
Nov 14 19:20:15 user nova-compute[75205]:     </disk>
Nov 14 19:20:15 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:20:15 user nova-compute[75205]:       <mac address="fa:16:3e:53:48:58"/>
Nov 14 19:20:15 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:20:15 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:20:15 user nova-compute[75205]:       <target dev="tapad5f1ef2-eb"/>
Nov 14 19:20:15 user nova-compute[75205]:     </interface>
Nov 14 19:20:15 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:20:15 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/console.log" append="off"/>
Nov 14 19:20:15 user nova-compute[75205]:     </serial>
Nov 14 19:20:15 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:20:15 user nova-compute[75205]:     <video>
Nov 14 19:20:15 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:20:15 user nova-compute[75205]:     </video>
Nov 14 19:20:15 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:20:15 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:20:15 user nova-compute[75205]:     </rng>
Nov 14 19:20:15 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:20:15 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:20:15 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:20:15 user nova-compute[75205]:     </memballoon>
Nov 14 19:20:15 user nova-compute[75205]:   </devices>
Nov 14 19:20:15 user nova-compute[75205]: </domain>
Nov 14 19:20:15 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1344472545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1344472545',id=31,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-rf8l979h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:19:53Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=1ec04cbd-a532-4e15-ba88-a87e6d41e249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:48:58,bridge_name='br-int',has_traffic_filtering=True,id=ad5f1ef2-ebe2-4f5f-8777-891848473af2,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5f1ef2-eb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG os_vif [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:48:58,bridge_name='br-int',has_traffic_filtering=True,id=ad5f1ef2-ebe2-4f5f-8777-891848473af2,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5f1ef2-eb') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48fb1c19-7933-54f1-8670-827451ab5a8d', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad5f1ef2-eb, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad5f1ef2-eb, col_values=(('qos', UUID('1c34cbf6-16b8-4bde-bcae-d5a838ff7ef6')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad5f1ef2-eb, col_values=(('external_ids', {'iface-id': 'ad5f1ef2-ebe2-4f5f-8777-891848473af2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:48:58', 'vm-uuid': '1ec04cbd-a532-4e15-ba88-a87e6d41e249'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:15 user nova-compute[75205]: INFO os_vif [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:48:58,bridge_name='br-int',has_traffic_filtering=True,id=ad5f1ef2-ebe2-4f5f-8777-891848473af2,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5f1ef2-eb')
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No VIF found with MAC fa:16:3e:53:48:58, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:20:15 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:20:15 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Took 0.71 seconds to deallocate network for instance.
Nov 14 19:20:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:16 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:20:16 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:20:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:16 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Deleted allocations for instance 3c53f075-6a96-4961-a89f-a5afffe1711f
Nov 14 19:20:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bf364f79-6b3c-4a8f-8350-05815b5c33f2 tempest-TestVolumeSwap-999383946 tempest-TestVolumeSwap-999383946-project-member] Lock "3c53f075-6a96-4961-a89f-a5afffe1711f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-ff9315f1-2f8b-45ec-a1db-803fe6815ab1 req-842c8a9c-0f5f-464c-aef2-5d521a456abf service nova] [instance: 3c53f075-6a96-4961-a89f-a5afffe1711f] Received event network-vif-deleted-a1c75ae0-844b-4b14-a4d8-77f116a65a6c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:18 user nova-compute[75205]: WARNING nova.compute.manager [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state building and task_state spawning.
Nov 14 19:20:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:18 user nova-compute[75205]: WARNING nova.compute.manager [req-5b710f6a-b240-4899-89f0-fbfddeb34486 req-fdbf8af8-1f98-4f11-934b-22692c234c1b service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state building and task_state spawning.
Nov 14 19:20:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:20:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:20:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Instance spawned successfully.
Nov 14 19:20:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:20:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:19 user nova-compute[75205]: INFO nova.compute.manager [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 14 19:20:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:20:19 user nova-compute[75205]: INFO nova.compute.manager [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Took 26.67 seconds to build instance.
Nov 14 19:20:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fa8b5766-0707-4be4-a951-45d06b4c3f6a tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.767s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:20:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:20:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:20:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:20:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:20:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:20:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:20:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:30 user nova-compute[75205]: DEBUG nova.compute.manager [req-b0078ab1-8ff9-405d-806e-7645facb3e96 req-37eb9296-6d57-4e18-b88b-6b60de7cfe34 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-changed-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:30 user nova-compute[75205]: DEBUG nova.compute.manager [req-b0078ab1-8ff9-405d-806e-7645facb3e96 req-37eb9296-6d57-4e18-b88b-6b60de7cfe34 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Refreshing instance network info cache due to event network-changed-7989cadb-ee49-4c2e-836f-655dc71f5576. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:20:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b0078ab1-8ff9-405d-806e-7645facb3e96 req-37eb9296-6d57-4e18-b88b-6b60de7cfe34 service nova] Acquiring lock "refresh_cache-76a6c07f-15b9-4640-bc5a-8f288c7aba99" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:20:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b0078ab1-8ff9-405d-806e-7645facb3e96 req-37eb9296-6d57-4e18-b88b-6b60de7cfe34 service nova] Acquired lock "refresh_cache-76a6c07f-15b9-4640-bc5a-8f288c7aba99" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:20:30 user nova-compute[75205]: DEBUG nova.network.neutron [req-b0078ab1-8ff9-405d-806e-7645facb3e96 req-37eb9296-6d57-4e18-b88b-6b60de7cfe34 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Refreshing network info cache for port 7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG nova.objects.instance [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'flavor' on Instance uuid 76a6c07f-15b9-4640-bc5a-8f288c7aba99 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG nova.network.neutron [req-b0078ab1-8ff9-405d-806e-7645facb3e96 req-37eb9296-6d57-4e18-b88b-6b60de7cfe34 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Updated VIF entry in instance network info cache for port 7989cadb-ee49-4c2e-836f-655dc71f5576. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG nova.network.neutron [req-b0078ab1-8ff9-405d-806e-7645facb3e96 req-37eb9296-6d57-4e18-b88b-6b60de7cfe34 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Updating instance_info_cache with network_info: [{"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b0078ab1-8ff9-405d-806e-7645facb3e96 req-37eb9296-6d57-4e18-b88b-6b60de7cfe34 service nova] Releasing lock "refresh_cache-76a6c07f-15b9-4640-bc5a-8f288c7aba99" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:31 user nova-compute[75205]: INFO nova.compute.manager [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Attaching volume 0eff452a-8d32-4e11-90df-fc8a9b25a11a to /dev/vdb
Nov 14 19:20:31 user nova-compute[75205]: DEBUG os_brick.utils [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[839db7e7-ff92-4733-99f2-a609249b9bd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370c561-3148-4588-acf9-4f27e298899d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d26fe1d-62c8-4b5f-a963-568deb4101f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7862ef-d8dc-4122-b01f-5fa698c6a613]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:20:31 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:20:31 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a60961c-b2ee-44d1-9896-6275b4038364]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG os_brick.utils [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:31 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Updating existing volume attachment record: bb6ee060-3f00-4646-b793-7aed05ec132b {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updating instance_info_cache with network_info: [{"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhcCeLWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:36 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:36 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:36 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd74c91e-e452-4592-9855-284b9bb7c3a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:20:36 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfdb4ea-1d8f-4ff7-b434-af7f85d5c6e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a] added
Nov 14 19:20:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eaf945-7356-4064-a120-e98e01af9298]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d06b4b4-cb5f-48be-b6e8-9f6475d5c4fe]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZhcCeLWt {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZhcCeLWt" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[738c4fb9-6ec1-4c77-88c4-0b1f0938f016]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZhcCeLWt'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81c3f13-16f3-48fb-aa81-f5af24ef3b00]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac5784-0789-4444-ab2a-a1ea96bb9efe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c31e417-8e11-4937-83eb-f7afad14bdd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260]
Nov 14 19:20:36 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260] successful.
Nov 14 19:20:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e883841b-d972-46ab-8f92-2e693594fa9f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecf6e3e-259e-4779-a350-5e8bb826f5b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:20:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:36 user nova-compute[75205]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:20:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:20:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[293f5b80-e198-4e63-a7ca-a5d1057d8eda]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhcCeLWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.754s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== connect_volume: return (757ms) {'type': 'block', 'scsi_wwn': '23861613931613039', 'path': '/dev/sde'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861613931613039', 'path': '/dev/sde'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:20:37 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:20:37 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7054MB free_disk=24.95690155029297GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.objects.instance [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'flavor' on Instance uuid 76a6c07f-15b9-4640-bc5a-8f288c7aba99 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:20:37 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:20:37 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:20:37 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:20:37 user nova-compute[75205]:   <serial>0eff452a-8d32-4e11-90df-fc8a9b25a11a</serial>
Nov 14 19:20:37 user nova-compute[75205]: </disk>
Nov 14 19:20:37 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6864c442-8284-4dd8-8165-ff891e5d5175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2a32bb26-deb4-407d-a9e9-31de887e0b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 87a00d85-b082-4f6e-8869-987e01a91fa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance c7744d82-c045-4602-9d7a-83f7d331a77e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d1a77658-d712-402d-b67b-322751e2f202 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1ec04cbd-a532-4e15-ba88-a87e6d41e249 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No VIF found with MAC fa:16:3e:3d:74:7e, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4a1e56bc-2e41-4a03-9b55-3d6cb2123ebd tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.247s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:38 user nova-compute[75205]: INFO nova.compute.manager [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Rebuilding instance
Nov 14 19:20:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:20:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-27c3944c-6db3-4415-94d1-29f5e6ce4ff4 req-b6ff0c84-5b51-4c94-9f90-814013dd54c9 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-vif-unplugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-27c3944c-6db3-4415-94d1-29f5e6ce4ff4 req-b6ff0c84-5b51-4c94-9f90-814013dd54c9 service nova] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-27c3944c-6db3-4415-94d1-29f5e6ce4ff4 req-b6ff0c84-5b51-4c94-9f90-814013dd54c9 service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-27c3944c-6db3-4415-94d1-29f5e6ce4ff4 req-b6ff0c84-5b51-4c94-9f90-814013dd54c9 service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-27c3944c-6db3-4415-94d1-29f5e6ce4ff4 req-b6ff0c84-5b51-4c94-9f90-814013dd54c9 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] No waiting events found dispatching network-vif-unplugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:39 user nova-compute[75205]: WARNING nova.compute.manager [req-27c3944c-6db3-4415-94d1-29f5e6ce4ff4 req-b6ff0c84-5b51-4c94-9f90-814013dd54c9 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received unexpected event network-vif-unplugged-7989cadb-ee49-4c2e-836f-655dc71f5576 for instance with vm_state active and task_state rebuilding.
Nov 14 19:20:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Instance destroyed successfully.
Nov 14 19:20:39 user nova-compute[75205]: INFO nova.compute.manager [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Detaching volume 0eff452a-8d32-4e11-90df-fc8a9b25a11a
Nov 14 19:20:39 user nova-compute[75205]: INFO nova.virt.block_device [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Attempting to driver detach volume 0eff452a-8d32-4e11-90df-fc8a9b25a11a from mountpoint /dev/vdb
Nov 14 19:20:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Attempting to detach device vdb from instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:20:39 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:20:39 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:20:39 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:20:39 user nova-compute[75205]:   <serial>0eff452a-8d32-4e11-90df-fc8a9b25a11a</serial>
Nov 14 19:20:39 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:20:39 user nova-compute[75205]: </disk>
Nov 14 19:20:39 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:20:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully detached device vdb from instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 from the persistent domain config.
Nov 14 19:20:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhcCeLWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:39 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bc3f1f-a409-45e5-9927-06401629ff59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:20:39 user nova-compute[75205]: No targets found.
Nov 14 19:20:39 user nova-compute[75205]: iSNS:
Nov 14 19:20:39 user nova-compute[75205]: No targets found.
Nov 14 19:20:39 user nova-compute[75205]: STATIC:
Nov 14 19:20:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a
Nov 14 19:20:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:20:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:20:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:20:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:20:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:20:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:20:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:20:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:20:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d
Nov 14 19:20:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:20:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:20:39 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0
Nov 14 19:20:39 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:20:39 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:20:39 user nova-compute[75205]: FIRMWARE:
Nov 14 19:20:39 user nova-compute[75205]: No targets found.
Nov 14 19:20:39 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:20:39 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:20:39 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d684783a-e487-455d-a3fd-55c7f8c09f21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8873c66b-4e88-433d-acdf-9ae2a45f5401]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:39 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:39 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:39 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:39 user nova-compute[75205]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:20:39 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:39 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:39 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:39 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:39 user nova-compute[75205]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:20:39 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb9423a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a'): ({'sde'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Removing single pathed devices sde {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62e8149-de19-4df8-8562-ce3744d64689]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d2879-c630-4fd7-b69e-5dc96d5b0905]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flushing IO for device /dev/sde {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[222a8f20-36f7-46df-bdb2-6d69f120c4e4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9772f8f-93fb-4e61-969e-1cd2b2b0b29d]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:20:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0052d81-36ca-45e8-a22d-d3f9bfd4d8ee]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[364fda9e-4cc1-4fe4-ac49-a2d58bd24d36]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260]
Nov 14 19:20:40 user nova-compute[75205]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260] successful.
Nov 14 19:20:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee5cebb-9897-4179-b424-79d50e1d0d25]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== disconnect_volume: return (341ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-1f1c8d47-ac74-4053-9090-5644df82184b req-deed8bb3-4b42-441f-bb91-32551d1dbe69 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received event network-changed-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-1f1c8d47-ac74-4053-9090-5644df82184b req-deed8bb3-4b42-441f-bb91-32551d1dbe69 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Refreshing instance network info cache due to event network-changed-9c1f080d-e8d5-4c84-95c4-4e638a14c190. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1f1c8d47-ac74-4053-9090-5644df82184b req-deed8bb3-4b42-441f-bb91-32551d1dbe69 service nova] Acquiring lock "refresh_cache-7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1f1c8d47-ac74-4053-9090-5644df82184b req-deed8bb3-4b42-441f-bb91-32551d1dbe69 service nova] Acquired lock "refresh_cache-7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG nova.network.neutron [req-1f1c8d47-ac74-4053-9090-5644df82184b req-deed8bb3-4b42-441f-bb91-32551d1dbe69 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Refreshing network info cache for port 9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG nova.network.neutron [req-1f1c8d47-ac74-4053-9090-5644df82184b req-deed8bb3-4b42-441f-bb91-32551d1dbe69 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Updated VIF entry in instance network info cache for port 9c1f080d-e8d5-4c84-95c4-4e638a14c190. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG nova.network.neutron [req-1f1c8d47-ac74-4053-9090-5644df82184b req-deed8bb3-4b42-441f-bb91-32551d1dbe69 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Updating instance_info_cache with network_info: [{"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1f1c8d47-ac74-4053-9090-5644df82184b req-deed8bb3-4b42-441f-bb91-32551d1dbe69 service nova] Releasing lock "refresh_cache-7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:20:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Instance destroyed successfully.
Nov 14 19:20:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-54069087',display_name='tempest-ServerActionsTestOtherA-server-925782016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-54069087',id=28,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmFMu1MhmNNODqxye2oYQgfRj0rdLs44i/hgnq8MB347rg/uZ2vJKnDG8bTLCgPOHpMZNKcMILt0sMLy2yvyzP3vcTosOElc4xxRalFM4BT+P3pJ71xkhxpnimPcAPydA==',key_name='tempest-keypair-137945461',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-yx5vb0xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=76a6c07f-15b9-4640-bc5a-8f288c7aba99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_vif [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7989cadb-ee, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=863f8992-3ec2-4833-b128-20dbbefa8626) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:41 user nova-compute[75205]: INFO os_vif [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee')
Nov 14 19:20:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhcCeLWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:41 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[00791672-208e-42a8-bc16-1c3d428613a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:20:41 user nova-compute[75205]: No targets found.
Nov 14 19:20:41 user nova-compute[75205]: iSNS:
Nov 14 19:20:41 user nova-compute[75205]: No targets found.
Nov 14 19:20:41 user nova-compute[75205]: STATIC:
Nov 14 19:20:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:20:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:20:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:20:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:20:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:20:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:20:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d
Nov 14 19:20:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:20:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:20:41 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0
Nov 14 19:20:41 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:20:41 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:20:41 user nova-compute[75205]: FIRMWARE:
Nov 14 19:20:41 user nova-compute[75205]: No targets found.
Nov 14 19:20:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:20:41 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:20:41 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-92dfef55-4786-4790-9480-4563e1f22dea req-07cc495a-fac4-4909-a423-8bd5ae0af03e service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-92dfef55-4786-4790-9480-4563e1f22dea req-07cc495a-fac4-4909-a423-8bd5ae0af03e service nova] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-92dfef55-4786-4790-9480-4563e1f22dea req-07cc495a-fac4-4909-a423-8bd5ae0af03e service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-92dfef55-4786-4790-9480-4563e1f22dea req-07cc495a-fac4-4909-a423-8bd5ae0af03e service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-92dfef55-4786-4790-9480-4563e1f22dea req-07cc495a-fac4-4909-a423-8bd5ae0af03e service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] No waiting events found dispatching network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:41 user nova-compute[75205]: WARNING nova.compute.manager [req-92dfef55-4786-4790-9480-4563e1f22dea req-07cc495a-fac4-4909-a423-8bd5ae0af03e service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received unexpected event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 for instance with vm_state active and task_state rebuilding.
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c5c911-530e-4a48-b687-c972d0432c30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07483ba-9b2a-4871-a258-5c9adff02f5c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:41 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:41 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:41 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:41 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:41 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:41 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb54789990>, {}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Disconnecting from: [] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== disconnect_volume: return (78ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:20:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Deleting instance files /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99_del
Nov 14 19:20:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Deletion of /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99_del complete
Nov 14 19:20:41 user nova-compute[75205]: INFO nova.virt.block_device [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Booting with volume 0eff452a-8d32-4e11-90df-fc8a9b25a11a at /dev/vdb
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.utils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1694eef-a1ca-4eda-a0e9-bea40223ea6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[088f7727-c207-46a0-94c7-db7bc192cd7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e1fb53-6486-45a3-8774-1298ecae6df6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c1ed9d-0665-45da-9711-48cac67d6ce7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:20:41 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0265c19-0164-461d-b856-d405b356ae55]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG os_brick.utils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Updating existing volume attachment record: 2cd35e71-6cc9-48c4-8d7b-5b9c8af11026 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG nova.objects.instance [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'flavor' on Instance uuid 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:42 user nova-compute[75205]: INFO nova.compute.manager [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Attaching volume 4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 to /dev/vdb
Nov 14 19:20:42 user nova-compute[75205]: DEBUG os_brick.utils [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dcf59e-787c-4f7f-a67f-bf7a970322e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca597db1-8811-4e9b-94db-069a46d4af74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[882476b0-23ab-4e85-8620-b7f10c4c6af1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bee101-6496-49db-8ce4-61c7b0e4ed44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:20:42 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:20:42 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee12e6c-8fe4-4501-903e-afb48a9a4f18]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG os_brick.utils [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:42 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Updating existing volume attachment record: c2a15893-ed7b-42bd-8563-2ac9353e06b9 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:20:46 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Creating image(s)
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "/opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "/opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "/opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhzMXcgt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:46 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:46 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:46 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[222bbbdb-b528-43a9-8b18-5bbcf14a412b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:20:46 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca6a0e7-c2d0-4cb1-a13e-1ee1c2da50a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853] added
Nov 14 19:20:46 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a32862f-a1ab-4605-b279-61a87654e785]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[60814344-843c-4f07-86a4-c19aae5e09ed]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhzMXcgt {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhzMXcgt" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd71fcb-9f45-45be-bf76-911625a8d55b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PhzMXcgt'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8959b22-29b8-4e35-a9d4-a72a5b71ea11]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk 1073741824" returned: 0 in 0.050s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c19f2b-c1b3-4cf2-9902-93e1ca842c44]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed399211-023f-45a7-ac21-929a79bd85f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853, portal: 172.16.0.220,3260]
Nov 14 19:20:46 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853, portal: 172.16.0.220,3260] successful.
Nov 14 19:20:46 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[338d3a80-dd57-4bb8-89aa-f9d6f7924c37]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47ef105-b165-428f-acb2-474188e7147d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)
Nov 14 19:20:46 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f99573-bbf0-4ce9-8fda-9c788f6f93eb]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhzMXcgt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Cannot resize image /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Ensure instance console log exists: /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Start _get_guest_xml network_info=[{"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhcCeLWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76a6c07f-15b9-4640-bc5a-8f288c7aba99', 'attached_at': '', 'detached_at': '', 'volume_id': '0eff452a-8d32-4e11-90df-fc8a9b25a11a', 'serial': '0eff452a-8d32-4e11-90df-fc8a9b25a11a'}, 'attachment_id': '2cd35e71-6cc9-48c4-8d7b-5b9c8af11026', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:20:47 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 19:20:47 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.objects.instance [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76a6c07f-15b9-4640-bc5a-8f288c7aba99 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:20:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhcCeLWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:20:47 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 19:20:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23163633163343239', 'path': '/dev/sde'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163633163343239', 'path': '/dev/sde'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.792s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:48 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:20:48 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG nova.objects.instance [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'flavor' on Instance uuid 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71455e6-fb5f-4094-a443-17ad0ffaa0d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:20:48 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:20:48 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:20:48 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:20:48 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:20:48 user nova-compute[75205]:   <serial>4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853</serial>
Nov 14 19:20:48 user nova-compute[75205]: </disk>
Nov 14 19:20:48 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5aa4c2-dced-47c1-924d-7e56f3357fd9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a] added
Nov 14 19:20:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[182d3121-8b03-4324-8ddf-9af9acf305a8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea379c-f57d-4c77-88ae-74737f555f0b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZhcCeLWt {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZhcCeLWt" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[88357d7f-c2cb-4a3f-bc24-1d93c4b05d36]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZhcCeLWt'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e4f3a6-2bf9-4387-8f00-ab74c8f24697]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82363aa-e588-4731-9593-241034e68127]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b50066-450b-4562-893d-caaa8dd6e625]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260]
Nov 14 19:20:48 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260] successful.
Nov 14 19:20:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd81925c-c3d5-4ae1-90bb-2a57f47ee09f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f491c973-aa75-42c0-9953-add501fd0112]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:20:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)
Nov 14 19:20:48 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:20:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74a0b3b-fe5a-421d-aecd-eb134c2a2122]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhcCeLWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] No VIF found with MAC fa:16:3e:c8:b7:9c, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:20:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-63857672-54d3-447d-b4ec-5feca70defaf tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.618s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== connect_volume: return (2142ms) {'type': 'block', 'scsi_wwn': '23861613931613039', 'path': '/dev/sdf'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861613931613039', 'path': '/dev/sdf'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-54069087',display_name='tempest-ServerActionsTestOtherA-server-925782016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-54069087',id=28,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmFMu1MhmNNODqxye2oYQgfRj0rdLs44i/hgnq8MB347rg/uZ2vJKnDG8bTLCgPOHpMZNKcMILt0sMLy2yvyzP3vcTosOElc4xxRalFM4BT+P3pJ71xkhxpnimPcAPydA==',key_name='tempest-keypair-137945461',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-yx5vb0xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:20:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=76a6c07f-15b9-4640-bc5a-8f288c7aba99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:20:49 user nova-compute[75205]:   <uuid>76a6c07f-15b9-4640-bc5a-8f288c7aba99</uuid>
Nov 14 19:20:49 user nova-compute[75205]:   <name>instance-0000001c</name>
Nov 14 19:20:49 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:20:49 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:20:49 user nova-compute[75205]:   <metadata>
Nov 14 19:20:49 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:20:49 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:20:49 user nova-compute[75205]:       <nova:name>tempest-ServerActionsTestOtherA-server-925782016</nova:name>
Nov 14 19:20:49 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:20:47</nova:creationTime>
Nov 14 19:20:49 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:20:49 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:20:49 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:20:49 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:20:49 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:20:49 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:20:49 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:20:49 user nova-compute[75205]:       <nova:owner>
Nov 14 19:20:49 user nova-compute[75205]:         <nova:user uuid="f89ca9b3c52040acbc46581ac5cf55b9">tempest-ServerActionsTestOtherA-410645410-project-member</nova:user>
Nov 14 19:20:49 user nova-compute[75205]:         <nova:project uuid="55021da245654f6392681359d51cbc9d">tempest-ServerActionsTestOtherA-410645410</nova:project>
Nov 14 19:20:49 user nova-compute[75205]:       </nova:owner>
Nov 14 19:20:49 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:20:49 user nova-compute[75205]:       <nova:ports>
Nov 14 19:20:49 user nova-compute[75205]:         <nova:port uuid="7989cadb-ee49-4c2e-836f-655dc71f5576">
Nov 14 19:20:49 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 19:20:49 user nova-compute[75205]:         </nova:port>
Nov 14 19:20:49 user nova-compute[75205]:       </nova:ports>
Nov 14 19:20:49 user nova-compute[75205]:     </nova:instance>
Nov 14 19:20:49 user nova-compute[75205]:   </metadata>
Nov 14 19:20:49 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:20:49 user nova-compute[75205]:     <system>
Nov 14 19:20:49 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:20:49 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:20:49 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:20:49 user nova-compute[75205]:       <entry name="serial">76a6c07f-15b9-4640-bc5a-8f288c7aba99</entry>
Nov 14 19:20:49 user nova-compute[75205]:       <entry name="uuid">76a6c07f-15b9-4640-bc5a-8f288c7aba99</entry>
Nov 14 19:20:49 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:20:49 user nova-compute[75205]:     </system>
Nov 14 19:20:49 user nova-compute[75205]:   </sysinfo>
Nov 14 19:20:49 user nova-compute[75205]:   <os>
Nov 14 19:20:49 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:20:49 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:20:49 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:20:49 user nova-compute[75205]:   </os>
Nov 14 19:20:49 user nova-compute[75205]:   <features>
Nov 14 19:20:49 user nova-compute[75205]:     <acpi/>
Nov 14 19:20:49 user nova-compute[75205]:     <apic/>
Nov 14 19:20:49 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:20:49 user nova-compute[75205]:   </features>
Nov 14 19:20:49 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:20:49 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:20:49 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:20:49 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:20:49 user nova-compute[75205]:   </clock>
Nov 14 19:20:49 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:20:49 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:20:49 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:20:49 user nova-compute[75205]:   </cpu>
Nov 14 19:20:49 user nova-compute[75205]:   <devices>
Nov 14 19:20:49 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:20:49 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:20:49 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk"/>
Nov 14 19:20:49 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:20:49 user nova-compute[75205]:     </disk>
Nov 14 19:20:49 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:20:49 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:20:49 user nova-compute[75205]:       <source dev="/dev/sdf"/>
Nov 14 19:20:49 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:20:49 user nova-compute[75205]:       <serial>0eff452a-8d32-4e11-90df-fc8a9b25a11a</serial>
Nov 14 19:20:49 user nova-compute[75205]:     </disk>
Nov 14 19:20:49 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:20:49 user nova-compute[75205]:       <mac address="fa:16:3e:3d:74:7e"/>
Nov 14 19:20:49 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:20:49 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:20:49 user nova-compute[75205]:       <target dev="tap7989cadb-ee"/>
Nov 14 19:20:49 user nova-compute[75205]:     </interface>
Nov 14 19:20:49 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:20:49 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/console.log" append="off"/>
Nov 14 19:20:49 user nova-compute[75205]:     </serial>
Nov 14 19:20:49 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:20:49 user nova-compute[75205]:     <video>
Nov 14 19:20:49 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:20:49 user nova-compute[75205]:     </video>
Nov 14 19:20:49 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:20:49 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:20:49 user nova-compute[75205]:     </rng>
Nov 14 19:20:49 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:20:49 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:20:49 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:20:49 user nova-compute[75205]:     </memballoon>
Nov 14 19:20:49 user nova-compute[75205]:   </devices>
Nov 14 19:20:49 user nova-compute[75205]: </domain>
Nov 14 19:20:49 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-54069087',display_name='tempest-ServerActionsTestOtherA-server-925782016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-54069087',id=28,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmFMu1MhmNNODqxye2oYQgfRj0rdLs44i/hgnq8MB347rg/uZ2vJKnDG8bTLCgPOHpMZNKcMILt0sMLy2yvyzP3vcTosOElc4xxRalFM4BT+P3pJ71xkhxpnimPcAPydA==',key_name='tempest-keypair-137945461',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-yx5vb0xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:20:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=76a6c07f-15b9-4640-bc5a-8f288c7aba99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG os_vif [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '762001bf-9582-5e1f-b211-9fcaff99caeb', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7989cadb-ee, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7989cadb-ee, col_values=(('qos', UUID('b17e54ac-f446-41c9-8a88-a3a7dbe906c4')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7989cadb-ee, col_values=(('external_ids', {'iface-id': '7989cadb-ee49-4c2e-836f-655dc71f5576', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:74:7e', 'vm-uuid': '76a6c07f-15b9-4640-bc5a-8f288c7aba99'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:49 user nova-compute[75205]: INFO os_vif [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee')
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No VIF found with MAC fa:16:3e:3d:74:7e, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:49 user nova-compute[75205]: INFO nova.compute.manager [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Detaching volume 4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853
Nov 14 19:20:50 user nova-compute[75205]: INFO nova.virt.block_device [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Attempting to driver detach volume 4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 from mountpoint /dev/vdb
Nov 14 19:20:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Attempting to detach device vdb from instance 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:20:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:20:50 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:20:50 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:20:50 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:20:50 user nova-compute[75205]:   <serial>4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853</serial>
Nov 14 19:20:50 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:20:50 user nova-compute[75205]: </disk>
Nov 14 19:20:50 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:20:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully detached device vdb from instance 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 from the persistent domain config.
Nov 14 19:20:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:20:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:20:50 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:20:50 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:20:50 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:20:50 user nova-compute[75205]:   <serial>4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853</serial>
Nov 14 19:20:50 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:20:50 user nova-compute[75205]: </disk>
Nov 14 19:20:50 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:20:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-f7b611ae-4f66-40b7-be2d-d95528048945 req-25e17d8e-1a87-4c26-a544-4918d1205c0f service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received event network-changed-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-f7b611ae-4f66-40b7-be2d-d95528048945 req-25e17d8e-1a87-4c26-a544-4918d1205c0f service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Refreshing instance network info cache due to event network-changed-6252e873-ddb2-4609-8706-f08ef733e5e0. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f7b611ae-4f66-40b7-be2d-d95528048945 req-25e17d8e-1a87-4c26-a544-4918d1205c0f service nova] Acquiring lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f7b611ae-4f66-40b7-be2d-d95528048945 req-25e17d8e-1a87-4c26-a544-4918d1205c0f service nova] Acquired lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG nova.network.neutron [req-f7b611ae-4f66-40b7-be2d-d95528048945 req-25e17d8e-1a87-4c26-a544-4918d1205c0f service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Refreshing network info cache for port 6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-412a1825-9fe3-427c-acd0-9c690ed1dcb9 req-9a89a9e8-cd5b-4e6c-9f7a-ed8f833ecd73 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-412a1825-9fe3-427c-acd0-9c690ed1dcb9 req-9a89a9e8-cd5b-4e6c-9f7a-ed8f833ecd73 service nova] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-412a1825-9fe3-427c-acd0-9c690ed1dcb9 req-9a89a9e8-cd5b-4e6c-9f7a-ed8f833ecd73 service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-412a1825-9fe3-427c-acd0-9c690ed1dcb9 req-9a89a9e8-cd5b-4e6c-9f7a-ed8f833ecd73 service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-412a1825-9fe3-427c-acd0-9c690ed1dcb9 req-9a89a9e8-cd5b-4e6c-9f7a-ed8f833ecd73 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] No waiting events found dispatching network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:51 user nova-compute[75205]: WARNING nova.compute.manager [req-412a1825-9fe3-427c-acd0-9c690ed1dcb9 req-9a89a9e8-cd5b-4e6c-9f7a-ed8f833ecd73 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received unexpected event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 19:20:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "87a00d85-b082-4f6e-8869-987e01a91fa0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:51 user nova-compute[75205]: INFO nova.compute.manager [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Terminating instance
Nov 14 19:20:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-f7b611ae-4f66-40b7-be2d-d95528048945 req-25e17d8e-1a87-4c26-a544-4918d1205c0f service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Updated VIF entry in instance network info cache for port 6252e873-ddb2-4609-8706-f08ef733e5e0. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-f7b611ae-4f66-40b7-be2d-d95528048945 req-25e17d8e-1a87-4c26-a544-4918d1205c0f service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Updating instance_info_cache with network_info: [{"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f7b611ae-4f66-40b7-be2d-d95528048945 req-25e17d8e-1a87-4c26-a544-4918d1205c0f service nova] Releasing lock "refresh_cache-87a00d85-b082-4f6e-8869-987e01a91fa0" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Instance destroyed successfully.
Nov 14 19:20:52 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lazy-loading 'resources' on Instance uuid 87a00d85-b082-4f6e-8869-987e01a91fa0 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1064691418',display_name='tempest-TestStampPattern-server-1064691418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1064691418',id=27,image_ref='5c500051-fe81-49c6-8792-8d8fff70418e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd1svgJTYybDPh1lPR3DIJKAtUs1FjktJwKG4A3pEzS7EJ21cmmx2eyxvLZzWkBvHvPEmdFTD/HrC2z/t88W02YyxzcpPr7NmabWOAd9mQhAqkZ+Jzq7r3Uf9KQEyTcwQ==',key_name='tempest-TestStampPattern-1251953881',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84244ff590a4bcaae6cc065b21cb12f',ramdisk_id='',reservation_id='r-3pj9nwa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6864c442-8284-4dd8-8165-ff891e5d5175',image_min_disk='1',image_min_ram='0',image_owner_id='b84244ff590a4bcaae6cc065b21cb12f',image_owner_project_name='tempest-TestStampPattern-719339764',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-719339764-project-member',image_user_id='67f99408d4954514aebc9d616ec5bcf0',owner_project_name='tempest-TestStampPattern-719339764',owner_user_name='tempest-TestStampPattern-719339764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:17:16Z,user_data=None,user_id='67f99408d4954514aebc9d616ec5bcf0',uuid=87a00d85-b082-4f6e-8869-987e01a91fa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converting VIF {"id": "6252e873-ddb2-4609-8706-f08ef733e5e0", "address": "fa:16:3e:ce:a9:ef", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6252e873-dd", "ovs_interfaceid": "6252e873-ddb2-4609-8706-f08ef733e5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=6252e873-ddb2-4609-8706-f08ef733e5e0,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6252e873-dd') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG os_vif [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=6252e873-ddb2-4609-8706-f08ef733e5e0,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6252e873-dd') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6252e873-dd, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86d2147d-d1e6-4f21-a4c4-9f76bc5ab067) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:52 user nova-compute[75205]: INFO os_vif [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=6252e873-ddb2-4609-8706-f08ef733e5e0,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6252e873-dd')
Nov 14 19:20:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Deleting instance files /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0_del
Nov 14 19:20:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Deletion of /opt/stack/data/nova/instances/87a00d85-b082-4f6e-8869-987e01a91fa0_del complete
Nov 14 19:20:52 user nova-compute[75205]: INFO nova.compute.manager [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 14 19:20:52 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:52 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:20:52 user nova-compute[75205]: INFO nova.compute.claims [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Claim successful on node user
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:20:53 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Took 0.48 seconds to deallocate network for instance.
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.287s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.network.neutron [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:20:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received event network-vif-unplugged-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] Acquiring lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] No waiting events found dispatching network-vif-unplugged-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:53 user nova-compute[75205]: WARNING nova.compute.manager [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received unexpected event network-vif-unplugged-6252e873-ddb2-4609-8706-f08ef733e5e0 for instance with vm_state deleted and task_state None.
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received event network-vif-plugged-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] Acquiring lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] No waiting events found dispatching network-vif-plugged-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:53 user nova-compute[75205]: WARNING nova.compute.manager [req-acf34f61-b867-44df-aa3a-f65d2701ab35 req-c17b7d31-a587-4f02-9593-8e7b9900cfe5 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received unexpected event network-vif-plugged-6252e873-ddb2-4609-8706-f08ef733e5e0 for instance with vm_state deleted and task_state None.
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.policy [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b03af1014734b1a8d4c2633756070e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eabb88364cd4173ba71aa8920d40954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-4d0f40af-fe6d-419b-9b68-04728d69ee4e req-a500ffcf-256b-45c4-8993-a0be0cb877c3 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4d0f40af-fe6d-419b-9b68-04728d69ee4e req-a500ffcf-256b-45c4-8993-a0be0cb877c3 service nova] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4d0f40af-fe6d-419b-9b68-04728d69ee4e req-a500ffcf-256b-45c4-8993-a0be0cb877c3 service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4d0f40af-fe6d-419b-9b68-04728d69ee4e req-a500ffcf-256b-45c4-8993-a0be0cb877c3 service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-4d0f40af-fe6d-419b-9b68-04728d69ee4e req-a500ffcf-256b-45c4-8993-a0be0cb877c3 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] No waiting events found dispatching network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:53 user nova-compute[75205]: WARNING nova.compute.manager [req-4d0f40af-fe6d-419b-9b68-04728d69ee4e req-a500ffcf-256b-45c4-8993-a0be0cb877c3 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received unexpected event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-4d0f40af-fe6d-419b-9b68-04728d69ee4e req-a500ffcf-256b-45c4-8993-a0be0cb877c3 service nova] [instance: 87a00d85-b082-4f6e-8869-987e01a91fa0] Received event network-vif-deleted-6252e873-ddb2-4609-8706-f08ef733e5e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:20:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Creating image(s)
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:20:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Instance spawned successfully.
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.198s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:20:53 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.574s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.010s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG nova.objects.instance [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75205) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 19:20:54 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Deleted allocations for instance 87a00d85-b082-4f6e-8869-987e01a91fa0
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk 1073741824" returned: 0 in 0.065s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-45b1fbc5-19cc-4b36-9e57-95056fe7a919 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.166s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9eadca00-75cb-464e-9e63-7708e3f9d649 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "87a00d85-b082-4f6e-8869-987e01a91fa0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.583s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Successfully created port: ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Cannot resize image /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Ensure instance console log exists: /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Successfully updated port: ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquired lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:20:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updating instance_info_cache with network_info: [{"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Releasing lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Instance network_info: |[{"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Start _get_guest_xml network_info=[{"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:20:55 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:20:55 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1382296437',display_name='tempest-ServerRescueNegativeTestJSON-server-1382296437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1382296437',id=32,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx4U+t4jtcgjmgFSJ+v+lTnWYR1BloB+eFgId25+qWaPBz41M/IStX7CJqL/vVNvD/TTJe7ZN6ebYa12QO6g9be/g1oyxCRNR9IfGtvmBsLdSzXlSfhLhDcm/EPZ0vNlw==',key_name='tempest-keypair-729185892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-2t2akl9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b03af1014734b1a8d4c2633756070e8',uuid=3ff88760-fa4a-4e52-a23e-6c60f54394cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:45,bridge_name='br-int',has_traffic_filtering=True,id=ee66e456-9848-4460-ad8d-4a5be982c145,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee66e456-98') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.objects.instance [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:20:55 user nova-compute[75205]:   <uuid>3ff88760-fa4a-4e52-a23e-6c60f54394cd</uuid>
Nov 14 19:20:55 user nova-compute[75205]:   <name>instance-00000020</name>
Nov 14 19:20:55 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:20:55 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:20:55 user nova-compute[75205]:   <metadata>
Nov 14 19:20:55 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:20:55 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:20:55 user nova-compute[75205]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1382296437</nova:name>
Nov 14 19:20:55 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:20:55</nova:creationTime>
Nov 14 19:20:55 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:20:55 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:20:55 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:20:55 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:20:55 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:20:55 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:20:55 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:20:55 user nova-compute[75205]:       <nova:owner>
Nov 14 19:20:55 user nova-compute[75205]:         <nova:user uuid="1b03af1014734b1a8d4c2633756070e8">tempest-ServerRescueNegativeTestJSON-278369752-project-member</nova:user>
Nov 14 19:20:55 user nova-compute[75205]:         <nova:project uuid="7eabb88364cd4173ba71aa8920d40954">tempest-ServerRescueNegativeTestJSON-278369752</nova:project>
Nov 14 19:20:55 user nova-compute[75205]:       </nova:owner>
Nov 14 19:20:55 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:20:55 user nova-compute[75205]:       <nova:ports>
Nov 14 19:20:55 user nova-compute[75205]:         <nova:port uuid="ee66e456-9848-4460-ad8d-4a5be982c145">
Nov 14 19:20:55 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:20:55 user nova-compute[75205]:         </nova:port>
Nov 14 19:20:55 user nova-compute[75205]:       </nova:ports>
Nov 14 19:20:55 user nova-compute[75205]:     </nova:instance>
Nov 14 19:20:55 user nova-compute[75205]:   </metadata>
Nov 14 19:20:55 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:20:55 user nova-compute[75205]:     <system>
Nov 14 19:20:55 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:20:55 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:20:55 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:20:55 user nova-compute[75205]:       <entry name="serial">3ff88760-fa4a-4e52-a23e-6c60f54394cd</entry>
Nov 14 19:20:55 user nova-compute[75205]:       <entry name="uuid">3ff88760-fa4a-4e52-a23e-6c60f54394cd</entry>
Nov 14 19:20:55 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:20:55 user nova-compute[75205]:     </system>
Nov 14 19:20:55 user nova-compute[75205]:   </sysinfo>
Nov 14 19:20:55 user nova-compute[75205]:   <os>
Nov 14 19:20:55 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:20:55 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:20:55 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:20:55 user nova-compute[75205]:   </os>
Nov 14 19:20:55 user nova-compute[75205]:   <features>
Nov 14 19:20:55 user nova-compute[75205]:     <acpi/>
Nov 14 19:20:55 user nova-compute[75205]:     <apic/>
Nov 14 19:20:55 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:20:55 user nova-compute[75205]:   </features>
Nov 14 19:20:55 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:20:55 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:20:55 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:20:55 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:20:55 user nova-compute[75205]:   </clock>
Nov 14 19:20:55 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:20:55 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:20:55 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:20:55 user nova-compute[75205]:   </cpu>
Nov 14 19:20:55 user nova-compute[75205]:   <devices>
Nov 14 19:20:55 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:20:55 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:20:55 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk"/>
Nov 14 19:20:55 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:20:55 user nova-compute[75205]:     </disk>
Nov 14 19:20:55 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:20:55 user nova-compute[75205]:       <mac address="fa:16:3e:a3:31:45"/>
Nov 14 19:20:55 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:20:55 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:20:55 user nova-compute[75205]:       <target dev="tapee66e456-98"/>
Nov 14 19:20:55 user nova-compute[75205]:     </interface>
Nov 14 19:20:55 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:20:55 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/console.log" append="off"/>
Nov 14 19:20:55 user nova-compute[75205]:     </serial>
Nov 14 19:20:55 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:20:55 user nova-compute[75205]:     <video>
Nov 14 19:20:55 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:20:55 user nova-compute[75205]:     </video>
Nov 14 19:20:55 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:20:55 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:20:55 user nova-compute[75205]:     </rng>
Nov 14 19:20:55 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:20:55 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:20:55 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:20:55 user nova-compute[75205]:     </memballoon>
Nov 14 19:20:55 user nova-compute[75205]:   </devices>
Nov 14 19:20:55 user nova-compute[75205]: </domain>
Nov 14 19:20:55 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1382296437',display_name='tempest-ServerRescueNegativeTestJSON-server-1382296437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1382296437',id=32,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx4U+t4jtcgjmgFSJ+v+lTnWYR1BloB+eFgId25+qWaPBz41M/IStX7CJqL/vVNvD/TTJe7ZN6ebYa12QO6g9be/g1oyxCRNR9IfGtvmBsLdSzXlSfhLhDcm/EPZ0vNlw==',key_name='tempest-keypair-729185892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-2t2akl9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b03af1014734b1a8d4c2633756070e8',uuid=3ff88760-fa4a-4e52-a23e-6c60f54394cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:45,bridge_name='br-int',has_traffic_filtering=True,id=ee66e456-9848-4460-ad8d-4a5be982c145,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee66e456-98') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG os_vif [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:45,bridge_name='br-int',has_traffic_filtering=True,id=ee66e456-9848-4460-ad8d-4a5be982c145,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee66e456-98') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47d03135-1a95-5334-bffa-273351df1672', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee66e456-98, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee66e456-98, col_values=(('qos', UUID('2a851c24-98e1-407d-bf84-590e822f160e')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee66e456-98, col_values=(('external_ids', {'iface-id': 'ee66e456-9848-4460-ad8d-4a5be982c145', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:31:45', 'vm-uuid': '3ff88760-fa4a-4e52-a23e-6c60f54394cd'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:55 user nova-compute[75205]: INFO os_vif [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:45,bridge_name='br-int',has_traffic_filtering=True,id=ee66e456-9848-4460-ad8d-4a5be982c145,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee66e456-98')
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No VIF found with MAC fa:16:3e:a3:31:45, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-ae7170da-cd9d-49d9-95f3-4a50278621bd req-4fee59b0-344d-4cb1-9559-f3d5bac5ce7c service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-changed-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-ae7170da-cd9d-49d9-95f3-4a50278621bd req-4fee59b0-344d-4cb1-9559-f3d5bac5ce7c service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Refreshing instance network info cache due to event network-changed-ee66e456-9848-4460-ad8d-4a5be982c145. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ae7170da-cd9d-49d9-95f3-4a50278621bd req-4fee59b0-344d-4cb1-9559-f3d5bac5ce7c service nova] Acquiring lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ae7170da-cd9d-49d9-95f3-4a50278621bd req-4fee59b0-344d-4cb1-9559-f3d5bac5ce7c service nova] Acquired lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:20:55 user nova-compute[75205]: DEBUG nova.network.neutron [req-ae7170da-cd9d-49d9-95f3-4a50278621bd req-4fee59b0-344d-4cb1-9559-f3d5bac5ce7c service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Refreshing network info cache for port ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:20:56 user nova-compute[75205]: DEBUG nova.network.neutron [req-ae7170da-cd9d-49d9-95f3-4a50278621bd req-4fee59b0-344d-4cb1-9559-f3d5bac5ce7c service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updated VIF entry in instance network info cache for port ee66e456-9848-4460-ad8d-4a5be982c145. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:20:56 user nova-compute[75205]: DEBUG nova.network.neutron [req-ae7170da-cd9d-49d9-95f3-4a50278621bd req-4fee59b0-344d-4cb1-9559-f3d5bac5ce7c service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updating instance_info_cache with network_info: [{"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:20:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ae7170da-cd9d-49d9-95f3-4a50278621bd req-4fee59b0-344d-4cb1-9559-f3d5bac5ce7c service nova] Releasing lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:20:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:20:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-fdff6367-9371-4cd3-bcdd-2fc0b7f5eb33 req-ba45f428-b441-4c66-b9e9-dfb61c5a5e05 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fdff6367-9371-4cd3-bcdd-2fc0b7f5eb33 req-ba45f428-b441-4c66-b9e9-dfb61c5a5e05 service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fdff6367-9371-4cd3-bcdd-2fc0b7f5eb33 req-ba45f428-b441-4c66-b9e9-dfb61c5a5e05 service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fdff6367-9371-4cd3-bcdd-2fc0b7f5eb33 req-ba45f428-b441-4c66-b9e9-dfb61c5a5e05 service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-fdff6367-9371-4cd3-bcdd-2fc0b7f5eb33 req-ba45f428-b441-4c66-b9e9-dfb61c5a5e05 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:57 user nova-compute[75205]: WARNING nova.compute.manager [req-fdff6367-9371-4cd3-bcdd-2fc0b7f5eb33 req-ba45f428-b441-4c66-b9e9-dfb61c5a5e05 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state building and task_state spawning.
Nov 14 19:20:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:20:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:20:58 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Instance spawned successfully.
Nov 14 19:20:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:20:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:20:59 user nova-compute[75205]: INFO nova.compute.manager [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 19:20:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:20:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-a244f35f-bdbb-48a3-955c-43db778d27fb req-20d395d2-e2a4-4e85-877d-7af4b3eacd2b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:20:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a244f35f-bdbb-48a3-955c-43db778d27fb req-20d395d2-e2a4-4e85-877d-7af4b3eacd2b service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:20:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a244f35f-bdbb-48a3-955c-43db778d27fb req-20d395d2-e2a4-4e85-877d-7af4b3eacd2b service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:20:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a244f35f-bdbb-48a3-955c-43db778d27fb req-20d395d2-e2a4-4e85-877d-7af4b3eacd2b service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:20:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-a244f35f-bdbb-48a3-955c-43db778d27fb req-20d395d2-e2a4-4e85-877d-7af4b3eacd2b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:20:59 user nova-compute[75205]: WARNING nova.compute.manager [req-a244f35f-bdbb-48a3-955c-43db778d27fb req-20d395d2-e2a4-4e85-877d-7af4b3eacd2b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state building and task_state spawning.
Nov 14 19:20:59 user nova-compute[75205]: INFO nova.compute.manager [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Took 6.29 seconds to build instance.
Nov 14 19:20:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2a28971d-b57e-4249-971a-4e78723f35ce tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.382s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:10 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 is timed out.
Nov 14 19:21:10 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully detached device vdb from instance 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 from the live domain config.
Nov 14 19:21:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhzMXcgt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:21:10 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:21:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd39c6-3b75-417c-9be0-34fab09352c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:21:10 user nova-compute[75205]: No targets found.
Nov 14 19:21:10 user nova-compute[75205]: iSNS:
Nov 14 19:21:10 user nova-compute[75205]: No targets found.
Nov 14 19:21:10 user nova-compute[75205]: STATIC:
Nov 14 19:21:10 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a
Nov 14 19:21:10 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:10 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:10 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853
Nov 14 19:21:10 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:10 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:10 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:21:10 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:10 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:10 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:21:10 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:10 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:10 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d
Nov 14 19:21:10 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:10 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:10 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0
Nov 14 19:21:10 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:10 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:10 user nova-compute[75205]: FIRMWARE:
Nov 14 19:21:10 user nova-compute[75205]: No targets found.
Nov 14 19:21:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:21:10 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:21:10 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1163ab-3508-4a68-b4dc-3761d6a87dca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[45604a11-710d-4606-94c1-5692bb78ea38]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:21:10 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:21:10 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:21:10 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:21:10 user nova-compute[75205]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)
Nov 14 19:21:10 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:21:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:21:10 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:21:10 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:21:10 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:21:10 user nova-compute[75205]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 (non-flash)
Nov 14 19:21:10 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:21:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb746243a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853'): ({'sde'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Removing single pathed devices sde {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a14190-4d7e-41c0-b095-18fcce3a6ec3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[202931bc-2b7a-4bb6-acf7-241e315cec73]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Flushing IO for device /dev/sde {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[06728474-49f9-460b-89c8-833b7f979392]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba08a1d-e845-4cc8-964b-474969b71c64]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[be71cf75-cc85-492d-8132-ebdb5edab73e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4db167c-3f38-4731-bc5b-dad5cc210805]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853, portal: 172.16.0.220,3260]
Nov 14 19:21:11 user nova-compute[75205]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853, portal: 172.16.0.220,3260] successful.
Nov 14 19:21:11 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4089a2c9-c0bc-4ba8-93fa-d3e16fb7b853 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e7ea0-8ec9-417b-b83f-1aa47a67d388]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] <== disconnect_volume: return (366ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:11 user nova-compute[75205]: DEBUG nova.objects.instance [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'flavor' on Instance uuid 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1ec637a1-8d68-4959-b0e7-0762866fa4db tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.077s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-8cc0fe7f-1dcf-4853-a926-147530fb73a4 req-6aa1ad8c-372d-4af8-9447-5a7f00ea6696 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received event network-changed-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-8cc0fe7f-1dcf-4853-a926-147530fb73a4 req-6aa1ad8c-372d-4af8-9447-5a7f00ea6696 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Refreshing instance network info cache due to event network-changed-05de1606-06bb-42c1-89f0-0e6d3bdb7812. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:21:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8cc0fe7f-1dcf-4853-a926-147530fb73a4 req-6aa1ad8c-372d-4af8-9447-5a7f00ea6696 service nova] Acquiring lock "refresh_cache-d1a77658-d712-402d-b67b-322751e2f202" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:21:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8cc0fe7f-1dcf-4853-a926-147530fb73a4 req-6aa1ad8c-372d-4af8-9447-5a7f00ea6696 service nova] Acquired lock "refresh_cache-d1a77658-d712-402d-b67b-322751e2f202" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:21:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-8cc0fe7f-1dcf-4853-a926-147530fb73a4 req-6aa1ad8c-372d-4af8-9447-5a7f00ea6696 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Refreshing network info cache for port 05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:21:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-8cc0fe7f-1dcf-4853-a926-147530fb73a4 req-6aa1ad8c-372d-4af8-9447-5a7f00ea6696 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Updated VIF entry in instance network info cache for port 05de1606-06bb-42c1-89f0-0e6d3bdb7812. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:21:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-8cc0fe7f-1dcf-4853-a926-147530fb73a4 req-6aa1ad8c-372d-4af8-9447-5a7f00ea6696 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Updating instance_info_cache with network_info: [{"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8cc0fe7f-1dcf-4853-a926-147530fb73a4 req-6aa1ad8c-372d-4af8-9447-5a7f00ea6696 service nova] Releasing lock "refresh_cache-d1a77658-d712-402d-b67b-322751e2f202" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:21:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:21:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:21:27 user nova-compute[75205]: INFO nova.compute.claims [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Claim successful on node user
Nov 14 19:21:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "7baa5285-c30b-451c-ab03-ce78ee2c498d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:21:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.360s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:21:28 user nova-compute[75205]: INFO nova.compute.claims [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Claim successful on node user
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:21:28 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.policy [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3e0b9e41b584048ae0c868ec72e89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bce9c4222254fe688cb54f69fe7bc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:21:28 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Creating image(s)
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "/opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "/opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk 1073741824" returned: 0 in 0.072s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Successfully created port: 9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:21:29 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.policy [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06b3b7a0f2ae441f8cb1d50891fcab94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fe039dc34949509e4ad72cd9da3bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:21:29 user nova-compute[75205]: INFO nova.virt.block_device [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Booting with volume snapshot 955c40bc-9633-4f00-b36a-80a2e6bfb3ed at /dev/vda
Nov 14 19:21:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Cannot resize image /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Ensure instance console log exists: /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Successfully updated port: 9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquired lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-d0ee8a6d-e903-4aa3-86c7-4e87e057d675 req-fff30553-5503-4970-9210-b9a64e51a208 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-changed-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-d0ee8a6d-e903-4aa3-86c7-4e87e057d675 req-fff30553-5503-4970-9210-b9a64e51a208 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Refreshing instance network info cache due to event network-changed-9e59c6ca-9156-4128-bcff-efbf329ac5c6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d0ee8a6d-e903-4aa3-86c7-4e87e057d675 req-fff30553-5503-4970-9210-b9a64e51a208 service nova] Acquiring lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:21:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Successfully created port: cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating instance_info_cache with network_info: [{"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Releasing lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Instance network_info: |[{"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d0ee8a6d-e903-4aa3-86c7-4e87e057d675 req-fff30553-5503-4970-9210-b9a64e51a208 service nova] Acquired lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.neutron [req-d0ee8a6d-e903-4aa3-86c7-4e87e057d675 req-fff30553-5503-4970-9210-b9a64e51a208 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Refreshing network info cache for port 9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Start _get_guest_xml network_info=[{"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:21:30 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:21:30 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1591317232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1591317232',id=33,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY8BN4OSjDQM9rqpkJC6Z7KTJgav9yS3Me+QYcBpJkEthzcRB7SVixd0ikK9C5zzMHVLxnztcwbe3psghv24kPmGsvMk6DW7JWIN5RcYEAx2G7/gaedbeU38l6UAtrTqg==',key_name='tempest-keypair-1469195162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-sjq8e8cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=6e5b652c-e7bf-4b77-bb84-db5c399cb538,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:21:30 user nova-compute[75205]:   <uuid>6e5b652c-e7bf-4b77-bb84-db5c399cb538</uuid>
Nov 14 19:21:30 user nova-compute[75205]:   <name>instance-00000021</name>
Nov 14 19:21:30 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:21:30 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:21:30 user nova-compute[75205]:   <metadata>
Nov 14 19:21:30 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:21:30 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:21:30 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1591317232</nova:name>
Nov 14 19:21:30 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:21:30</nova:creationTime>
Nov 14 19:21:30 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:21:30 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:21:30 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:21:30 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:21:30 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:21:30 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:21:30 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:21:30 user nova-compute[75205]:       <nova:owner>
Nov 14 19:21:30 user nova-compute[75205]:         <nova:user uuid="b3e0b9e41b584048ae0c868ec72e89a0">tempest-AttachVolumeShelveTestJSON-707756004-project-member</nova:user>
Nov 14 19:21:30 user nova-compute[75205]:         <nova:project uuid="1bce9c4222254fe688cb54f69fe7bc4a">tempest-AttachVolumeShelveTestJSON-707756004</nova:project>
Nov 14 19:21:30 user nova-compute[75205]:       </nova:owner>
Nov 14 19:21:30 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:21:30 user nova-compute[75205]:       <nova:ports>
Nov 14 19:21:30 user nova-compute[75205]:         <nova:port uuid="9e59c6ca-9156-4128-bcff-efbf329ac5c6">
Nov 14 19:21:30 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 19:21:30 user nova-compute[75205]:         </nova:port>
Nov 14 19:21:30 user nova-compute[75205]:       </nova:ports>
Nov 14 19:21:30 user nova-compute[75205]:     </nova:instance>
Nov 14 19:21:30 user nova-compute[75205]:   </metadata>
Nov 14 19:21:30 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:21:30 user nova-compute[75205]:     <system>
Nov 14 19:21:30 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:21:30 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:21:30 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:21:30 user nova-compute[75205]:       <entry name="serial">6e5b652c-e7bf-4b77-bb84-db5c399cb538</entry>
Nov 14 19:21:30 user nova-compute[75205]:       <entry name="uuid">6e5b652c-e7bf-4b77-bb84-db5c399cb538</entry>
Nov 14 19:21:30 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:21:30 user nova-compute[75205]:     </system>
Nov 14 19:21:30 user nova-compute[75205]:   </sysinfo>
Nov 14 19:21:30 user nova-compute[75205]:   <os>
Nov 14 19:21:30 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:21:30 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:21:30 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:21:30 user nova-compute[75205]:   </os>
Nov 14 19:21:30 user nova-compute[75205]:   <features>
Nov 14 19:21:30 user nova-compute[75205]:     <acpi/>
Nov 14 19:21:30 user nova-compute[75205]:     <apic/>
Nov 14 19:21:30 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:21:30 user nova-compute[75205]:   </features>
Nov 14 19:21:30 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:21:30 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:21:30 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:21:30 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:21:30 user nova-compute[75205]:   </clock>
Nov 14 19:21:30 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:21:30 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:21:30 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:21:30 user nova-compute[75205]:   </cpu>
Nov 14 19:21:30 user nova-compute[75205]:   <devices>
Nov 14 19:21:30 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:21:30 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:21:30 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk"/>
Nov 14 19:21:30 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:21:30 user nova-compute[75205]:     </disk>
Nov 14 19:21:30 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:21:30 user nova-compute[75205]:       <mac address="fa:16:3e:b7:a9:40"/>
Nov 14 19:21:30 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:21:30 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:21:30 user nova-compute[75205]:       <target dev="tap9e59c6ca-91"/>
Nov 14 19:21:30 user nova-compute[75205]:     </interface>
Nov 14 19:21:30 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:21:30 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/console.log" append="off"/>
Nov 14 19:21:30 user nova-compute[75205]:     </serial>
Nov 14 19:21:30 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:21:30 user nova-compute[75205]:     <video>
Nov 14 19:21:30 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:21:30 user nova-compute[75205]:     </video>
Nov 14 19:21:30 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:21:30 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:21:30 user nova-compute[75205]:     </rng>
Nov 14 19:21:30 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:21:30 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:21:30 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:21:30 user nova-compute[75205]:     </memballoon>
Nov 14 19:21:30 user nova-compute[75205]:   </devices>
Nov 14 19:21:30 user nova-compute[75205]: </domain>
Nov 14 19:21:30 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1591317232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1591317232',id=33,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY8BN4OSjDQM9rqpkJC6Z7KTJgav9yS3Me+QYcBpJkEthzcRB7SVixd0ikK9C5zzMHVLxnztcwbe3psghv24kPmGsvMk6DW7JWIN5RcYEAx2G7/gaedbeU38l6UAtrTqg==',key_name='tempest-keypair-1469195162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-sjq8e8cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=6e5b652c-e7bf-4b77-bb84-db5c399cb538,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG os_vif [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b12c435-a8d1-54fd-9fbf-81bf743e0fcd', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e59c6ca-91, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e59c6ca-91, col_values=(('qos', UUID('8df8dfe9-fe2f-4081-873e-8bf7e5ab671b')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e59c6ca-91, col_values=(('external_ids', {'iface-id': '9e59c6ca-9156-4128-bcff-efbf329ac5c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:a9:40', 'vm-uuid': '6e5b652c-e7bf-4b77-bb84-db5c399cb538'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:30 user nova-compute[75205]: INFO os_vif [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91')
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] No VIF found with MAC fa:16:3e:b7:a9:40, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.neutron [req-d0ee8a6d-e903-4aa3-86c7-4e87e057d675 req-fff30553-5503-4970-9210-b9a64e51a208 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updated VIF entry in instance network info cache for port 9e59c6ca-9156-4128-bcff-efbf329ac5c6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.neutron [req-d0ee8a6d-e903-4aa3-86c7-4e87e057d675 req-fff30553-5503-4970-9210-b9a64e51a208 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating instance_info_cache with network_info: [{"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d0ee8a6d-e903-4aa3-86c7-4e87e057d675 req-fff30553-5503-4970-9210-b9a64e51a208 service nova] Releasing lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Successfully updated port: cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "refresh_cache-7baa5285-c30b-451c-ab03-ce78ee2c498d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquired lock "refresh_cache-7baa5285-c30b-451c-ab03-ce78ee2c498d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.compute.manager [req-fc4f4527-0e7e-42ea-81f7-8d317c7f6dfd req-87a95140-4bfa-4d1e-b65e-727333b19fd3 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received event network-changed-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.compute.manager [req-fc4f4527-0e7e-42ea-81f7-8d317c7f6dfd req-87a95140-4bfa-4d1e-b65e-727333b19fd3 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Refreshing instance network info cache due to event network-changed-cc8ae615-f2e8-4d45-81ef-ac9237737cd5. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fc4f4527-0e7e-42ea-81f7-8d317c7f6dfd req-87a95140-4bfa-4d1e-b65e-727333b19fd3 service nova] Acquiring lock "refresh_cache-7baa5285-c30b-451c-ab03-ce78ee2c498d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Updating instance_info_cache with network_info: [{"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Releasing lock "refresh_cache-7baa5285-c30b-451c-ab03-ce78ee2c498d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Instance network_info: |[{"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fc4f4527-0e7e-42ea-81f7-8d317c7f6dfd req-87a95140-4bfa-4d1e-b65e-727333b19fd3 service nova] Acquired lock "refresh_cache-7baa5285-c30b-451c-ab03-ce78ee2c498d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:21:30 user nova-compute[75205]: DEBUG nova.network.neutron [req-fc4f4527-0e7e-42ea-81f7-8d317c7f6dfd req-87a95140-4bfa-4d1e-b65e-727333b19fd3 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Refreshing network info cache for port cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG nova.network.neutron [req-fc4f4527-0e7e-42ea-81f7-8d317c7f6dfd req-87a95140-4bfa-4d1e-b65e-727333b19fd3 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Updated VIF entry in instance network info cache for port cc8ae615-f2e8-4d45-81ef-ac9237737cd5. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG nova.network.neutron [req-fc4f4527-0e7e-42ea-81f7-8d317c7f6dfd req-87a95140-4bfa-4d1e-b65e-727333b19fd3 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Updating instance_info_cache with network_info: [{"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fc4f4527-0e7e-42ea-81f7-8d317c7f6dfd req-87a95140-4bfa-4d1e-b65e-727333b19fd3 service nova] Releasing lock "refresh_cache-7baa5285-c30b-451c-ab03-ce78ee2c498d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] No waiting events found dispatching network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:32 user nova-compute[75205]: WARNING nova.compute.manager [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received unexpected event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 for instance with vm_state building and task_state spawning.
Nov 14 19:21:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] No waiting events found dispatching network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:32 user nova-compute[75205]: WARNING nova.compute.manager [req-6b3ed0c2-5ceb-4f0b-96b1-d94a9a6cbeb8 req-8a6a8be6-d209-4f3a-8001-4e0433982680 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received unexpected event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 for instance with vm_state building and task_state spawning.
Nov 14 19:21:33 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:21:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:21:33 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Instance spawned successfully.
Nov 14 19:21:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:21:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:21:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:21:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:21:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:21:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:21:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:21:33 user nova-compute[75205]: INFO nova.compute.manager [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 19:21:33 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:21:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:33 user nova-compute[75205]: INFO nova.compute.manager [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Took 6.37 seconds to build instance.
Nov 14 19:21:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9b10e05e-183c-484b-8886-9d7a64cd8f62 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.464s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG os_brick.utils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac806c3-a0ae-4a32-bcd5-a958a610f12e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2541fa56-1b5b-4eb9-8bdf-f577a6bde775]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[860af389-321f-48d3-ba62-d8d958c39499]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8730ef27-0448-4cbd-9127-f9aa51c0c72a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:21:35 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[274fc1da-b7c3-4f14-9e9b-5933effdc8a7]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG os_brick.utils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Updating existing volume attachment record: 7d7571f6-7b94-4740-b718-71ed9e7f3d32 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:21:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:38 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:21:38 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:21:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7083MB free_disk=24.915176391601562GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:21:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6864c442-8284-4dd8-8165-ff891e5d5175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2a32bb26-deb4-407d-a9e9-31de887e0b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance c7744d82-c045-4602-9d7a-83f7d331a77e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d1a77658-d712-402d-b67b-322751e2f202 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1ec04cbd-a532-4e15-ba88-a87e6d41e249 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7baa5285-c30b-451c-ab03-ce78ee2c498d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:21:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:21:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Creating image(s)
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Ensure instance console log exists: /opt/stack/data/nova/instances/7baa5285-c30b-451c-ab03-ce78ee2c498d/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Start _get_guest_xml network_info=[{"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T19:21:23Z,direct_url=<?>,disk_format='qcow2',id=0b9d9b70-ac86-45e4-bea6-38a02294be98,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1375848527',owner='e2fe039dc34949509e4ad72cd9da3bf1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T19:21:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYLWKOeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7baa5285-c30b-451c-ab03-ce78ee2c498d', 'attached_at': '', 'detached_at': '', 'volume_id': '8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5', 'serial': '8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5'}, 'attachment_id': '7d7571f6-7b94-4740-b718-71ed9e7f3d32', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:21:40 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:21:40 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T19:21:23Z,direct_url=<?>,disk_format='qcow2',id=0b9d9b70-ac86-45e4-bea6-38a02294be98,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1375848527',owner='e2fe039dc34949509e4ad72cd9da3bf1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T19:21:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYLWKOeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:21:40 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:21:40 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:21:40 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e429491d-8b41-4d96-b892-13a62e07dfd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:21:40 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:40 user nova-compute[75205]: INFO nova.compute.manager [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Terminating instance
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df49d36-0516-4ee9-a345-bbaa5aa98614]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5] added
Nov 14 19:21:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4efd8d-2cee-4e8b-8955-22d58288dcf0]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e36dbd-5ae5-4490-9c46-9a2f7569b312]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYLWKOeV {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYLWKOeV" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a91e615-b5a1-4c80-8145-d24197194f97]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TYLWKOeV'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce98a580-0c19-4cca-89bd-fd912326491c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d4aa8d-61bb-4fa3-ac0b-cc663875c33e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:21:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:21:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fb9240-636e-4fe4-b5e9-5420ecc61dd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5, portal: 172.16.0.220,3260]
Nov 14 19:21:40 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5, portal: 172.16.0.220,3260] successful.
Nov 14 19:21:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2051fbce-0707-4864-ba37-e6941ce0026d req-e0303095-e4c0-4aaf-a260-2b5c182aa4cb service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received event network-vif-unplugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2051fbce-0707-4864-ba37-e6941ce0026d req-e0303095-e4c0-4aaf-a260-2b5c182aa4cb service nova] Acquiring lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2051fbce-0707-4864-ba37-e6941ce0026d req-e0303095-e4c0-4aaf-a260-2b5c182aa4cb service nova] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2051fbce-0707-4864-ba37-e6941ce0026d req-e0303095-e4c0-4aaf-a260-2b5c182aa4cb service nova] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2051fbce-0707-4864-ba37-e6941ce0026d req-e0303095-e4c0-4aaf-a260-2b5c182aa4cb service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] No waiting events found dispatching network-vif-unplugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-2051fbce-0707-4864-ba37-e6941ce0026d req-e0303095-e4c0-4aaf-a260-2b5c182aa4cb service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received event network-vif-unplugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ad367e-63dd-414e-aec2-e3084165c3ca]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[582fc978-8d1d-4f07-ac6e-c27eaebd6d98]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:21:40 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:21:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d6f527-41a8-4597-bca4-a4446ebfd4fa]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYLWKOeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:21:40 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:21:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Instance destroyed successfully.
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.objects.instance [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lazy-loading 'resources' on Instance uuid 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2104997043',display_name='tempest-AttachVolumeNegativeTest-server-2104997043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2104997043',id=29,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRAUXaCL0aehlodpjtzFf34EvHRZnkh8gUn0H8V5fQF7HPEuaJUsNn3+aTgkdDGJEFQpZS6JCEJ7RtkNG4rWhv4bweh+YBL2fVfr8ycO+WCbUbnuoUMqpdElxIOj9A5bA==',key_name='tempest-keypair-2104889956',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:18:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d42501d5d4964f49b8fe62e9c9c2bd24',ramdisk_id='',reservation_id='r-jmda6nji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1777396465',owner_user_name='tempest-AttachVolumeNegativeTest-1777396465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792e949c53df4fe390f93c0118590bb6',uuid=7e78a0e9-0d9a-4b00-a9e2-f5fd69517707,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converting VIF {"id": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "address": "fa:16:3e:c8:b7:9c", "network": {"id": "770f2d8b-6893-4161-9e3e-05dc87f379e0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1901235229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d42501d5d4964f49b8fe62e9c9c2bd24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1f080d-e8", "ovs_interfaceid": "9c1f080d-e8d5-4c84-95c4-4e638a14c190", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:b7:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c1f080d-e8d5-4c84-95c4-4e638a14c190,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1f080d-e8') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG os_vif [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:b7:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c1f080d-e8d5-4c84-95c4-4e638a14c190,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1f080d-e8') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c1f080d-e8, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updating instance_info_cache with network_info: [{"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea4d9d69-de05-4fb1-a47c-070063ff5d00) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: INFO os_vif [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:b7:9c,bridge_name='br-int',has_traffic_filtering=True,id=9c1f080d-e8d5-4c84-95c4-4e638a14c190,network=Network(770f2d8b-6893-4161-9e3e-05dc87f379e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1f080d-e8')
Nov 14 19:21:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Deleting instance files /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707_del
Nov 14 19:21:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Deletion of /opt/stack/data/nova/instances/7e78a0e9-0d9a-4b00-a9e2-f5fd69517707_del complete
Nov 14 19:21:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:21:41 user nova-compute[75205]: INFO nova.compute.manager [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 19:21:41 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23563356332613431', 'path': '/dev/sde'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563356332613431', 'path': '/dev/sde'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-300500849',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-300500849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-300500849',id=34,image_ref='0b9d9b70-ac86-45e4-bea6-38a02294be98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJcGiMcZo+bHKduSwiZaQVSbwZR+BJCRDWiU6cbNeludmMdXRAI+Ydq5NQTyTKjpFpgjJi6F55YCWdVoC3x1jwEBxCT86huw9zzya1ZxF1NS0rGEQ4hYWI2aXZP17GOFw==',key_name='tempest-keypair-1526811545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-k10it2v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-397278786',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=7baa5285-c30b-451c-ab03-ce78ee2c498d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2d:c4,bridge_name='br-int',has_traffic_filtering=True,id=cc8ae615-f2e8-4d45-81ef-ac9237737cd5,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8ae615-f2') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'pci_devices' on Instance uuid 7baa5285-c30b-451c-ab03-ce78ee2c498d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:21:41 user nova-compute[75205]:   <uuid>7baa5285-c30b-451c-ab03-ce78ee2c498d</uuid>
Nov 14 19:21:41 user nova-compute[75205]:   <name>instance-00000022</name>
Nov 14 19:21:41 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:21:41 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:21:41 user nova-compute[75205]:   <metadata>
Nov 14 19:21:41 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:21:41 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:21:41 user nova-compute[75205]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-300500849</nova:name>
Nov 14 19:21:41 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:21:40</nova:creationTime>
Nov 14 19:21:41 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:21:41 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:21:41 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:21:41 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:21:41 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:21:41 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:21:41 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:21:41 user nova-compute[75205]:       <nova:owner>
Nov 14 19:21:41 user nova-compute[75205]:         <nova:user uuid="06b3b7a0f2ae441f8cb1d50891fcab94">tempest-TestVolumeBootPattern-397278786-project-member</nova:user>
Nov 14 19:21:41 user nova-compute[75205]:         <nova:project uuid="e2fe039dc34949509e4ad72cd9da3bf1">tempest-TestVolumeBootPattern-397278786</nova:project>
Nov 14 19:21:41 user nova-compute[75205]:       </nova:owner>
Nov 14 19:21:41 user nova-compute[75205]:       <nova:root type="image" uuid="0b9d9b70-ac86-45e4-bea6-38a02294be98"/>
Nov 14 19:21:41 user nova-compute[75205]:       <nova:ports>
Nov 14 19:21:41 user nova-compute[75205]:         <nova:port uuid="cc8ae615-f2e8-4d45-81ef-ac9237737cd5">
Nov 14 19:21:41 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 19:21:41 user nova-compute[75205]:         </nova:port>
Nov 14 19:21:41 user nova-compute[75205]:       </nova:ports>
Nov 14 19:21:41 user nova-compute[75205]:     </nova:instance>
Nov 14 19:21:41 user nova-compute[75205]:   </metadata>
Nov 14 19:21:41 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:21:41 user nova-compute[75205]:     <system>
Nov 14 19:21:41 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:21:41 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:21:41 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:21:41 user nova-compute[75205]:       <entry name="serial">7baa5285-c30b-451c-ab03-ce78ee2c498d</entry>
Nov 14 19:21:41 user nova-compute[75205]:       <entry name="uuid">7baa5285-c30b-451c-ab03-ce78ee2c498d</entry>
Nov 14 19:21:41 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:21:41 user nova-compute[75205]:     </system>
Nov 14 19:21:41 user nova-compute[75205]:   </sysinfo>
Nov 14 19:21:41 user nova-compute[75205]:   <os>
Nov 14 19:21:41 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:21:41 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:21:41 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:21:41 user nova-compute[75205]:   </os>
Nov 14 19:21:41 user nova-compute[75205]:   <features>
Nov 14 19:21:41 user nova-compute[75205]:     <acpi/>
Nov 14 19:21:41 user nova-compute[75205]:     <apic/>
Nov 14 19:21:41 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:21:41 user nova-compute[75205]:   </features>
Nov 14 19:21:41 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:21:41 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:21:41 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:21:41 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:21:41 user nova-compute[75205]:   </clock>
Nov 14 19:21:41 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:21:41 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:21:41 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:21:41 user nova-compute[75205]:   </cpu>
Nov 14 19:21:41 user nova-compute[75205]:   <devices>
Nov 14 19:21:41 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:21:41 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:21:41 user nova-compute[75205]:       <source dev="/dev/sde"/>
Nov 14 19:21:41 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:21:41 user nova-compute[75205]:       <serial>8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5</serial>
Nov 14 19:21:41 user nova-compute[75205]:     </disk>
Nov 14 19:21:41 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:21:41 user nova-compute[75205]:       <mac address="fa:16:3e:44:2d:c4"/>
Nov 14 19:21:41 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:21:41 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:21:41 user nova-compute[75205]:       <target dev="tapcc8ae615-f2"/>
Nov 14 19:21:41 user nova-compute[75205]:     </interface>
Nov 14 19:21:41 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:21:41 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/7baa5285-c30b-451c-ab03-ce78ee2c498d/console.log" append="off"/>
Nov 14 19:21:41 user nova-compute[75205]:     </serial>
Nov 14 19:21:41 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:21:41 user nova-compute[75205]:     <video>
Nov 14 19:21:41 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:21:41 user nova-compute[75205]:     </video>
Nov 14 19:21:41 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:21:41 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:21:41 user nova-compute[75205]:     </rng>
Nov 14 19:21:41 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:21:41 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:21:41 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:21:41 user nova-compute[75205]:     </memballoon>
Nov 14 19:21:41 user nova-compute[75205]:   </devices>
Nov 14 19:21:41 user nova-compute[75205]: </domain>
Nov 14 19:21:41 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-300500849',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-300500849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-300500849',id=34,image_ref='0b9d9b70-ac86-45e4-bea6-38a02294be98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJcGiMcZo+bHKduSwiZaQVSbwZR+BJCRDWiU6cbNeludmMdXRAI+Ydq5NQTyTKjpFpgjJi6F55YCWdVoC3x1jwEBxCT86huw9zzya1ZxF1NS0rGEQ4hYWI2aXZP17GOFw==',key_name='tempest-keypair-1526811545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-k10it2v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-397278786',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=7baa5285-c30b-451c-ab03-ce78ee2c498d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2d:c4,bridge_name='br-int',has_traffic_filtering=True,id=cc8ae615-f2e8-4d45-81ef-ac9237737cd5,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8ae615-f2') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG os_vif [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2d:c4,bridge_name='br-int',has_traffic_filtering=True,id=cc8ae615-f2e8-4d45-81ef-ac9237737cd5,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8ae615-f2') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e37c1b57-7e17-5e6f-9ec9-448c630a9317', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc8ae615-f2, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc8ae615-f2, col_values=(('qos', UUID('f510bedc-4a38-4bc5-ac52-3597c5140fb0')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc8ae615-f2, col_values=(('external_ids', {'iface-id': 'cc8ae615-f2e8-4d45-81ef-ac9237737cd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:2d:c4', 'vm-uuid': '7baa5285-c30b-451c-ab03-ce78ee2c498d'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:41 user nova-compute[75205]: INFO os_vif [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2d:c4,bridge_name='br-int',has_traffic_filtering=True,id=cc8ae615-f2e8-4d45-81ef-ac9237737cd5,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8ae615-f2')
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No VIF found with MAC fa:16:3e:44:2d:c4, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:21:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:42 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:42 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Took 0.94 seconds to deallocate network for instance.
Nov 14 19:21:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-379c1adf-533e-4581-8582-b94b75c7e71d req-1b041125-6a69-482f-84d6-1aab43bbaa16 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received event network-vif-deleted-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-e8cd0301-fd19-48e7-be9b-2043c490c1e4 req-2d0e5049-8498-47ef-8a9c-57e2c9ba6745 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received event network-vif-plugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e8cd0301-fd19-48e7-be9b-2043c490c1e4 req-2d0e5049-8498-47ef-8a9c-57e2c9ba6745 service nova] Acquiring lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e8cd0301-fd19-48e7-be9b-2043c490c1e4 req-2d0e5049-8498-47ef-8a9c-57e2c9ba6745 service nova] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e8cd0301-fd19-48e7-be9b-2043c490c1e4 req-2d0e5049-8498-47ef-8a9c-57e2c9ba6745 service nova] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-e8cd0301-fd19-48e7-be9b-2043c490c1e4 req-2d0e5049-8498-47ef-8a9c-57e2c9ba6745 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] No waiting events found dispatching network-vif-plugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:42 user nova-compute[75205]: WARNING nova.compute.manager [req-e8cd0301-fd19-48e7-be9b-2043c490c1e4 req-2d0e5049-8498-47ef-8a9c-57e2c9ba6745 service nova] [instance: 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707] Received unexpected event network-vif-plugged-9c1f080d-e8d5-4c84-95c4-4e638a14c190 for instance with vm_state deleted and task_state None.
Nov 14 19:21:42 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:21:42 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:21:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.584s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:42 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Deleted allocations for instance 7e78a0e9-0d9a-4b00-a9e2-f5fd69517707
Nov 14 19:21:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-c1b37d1e-e0ef-41e8-9eb8-2815950abd5c tempest-AttachVolumeNegativeTest-1777396465 tempest-AttachVolumeNegativeTest-1777396465-project-member] Lock "7e78a0e9-0d9a-4b00-a9e2-f5fd69517707" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.648s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-b0325c64-b623-45d3-b2cf-baac184e83c0 req-2b8007e8-fc9b-4aaa-baeb-ff88dfb061ed service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received event network-vif-plugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b0325c64-b623-45d3-b2cf-baac184e83c0 req-2b8007e8-fc9b-4aaa-baeb-ff88dfb061ed service nova] Acquiring lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b0325c64-b623-45d3-b2cf-baac184e83c0 req-2b8007e8-fc9b-4aaa-baeb-ff88dfb061ed service nova] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b0325c64-b623-45d3-b2cf-baac184e83c0 req-2b8007e8-fc9b-4aaa-baeb-ff88dfb061ed service nova] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-b0325c64-b623-45d3-b2cf-baac184e83c0 req-2b8007e8-fc9b-4aaa-baeb-ff88dfb061ed service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] No waiting events found dispatching network-vif-plugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:43 user nova-compute[75205]: WARNING nova.compute.manager [req-b0325c64-b623-45d3-b2cf-baac184e83c0 req-2b8007e8-fc9b-4aaa-baeb-ff88dfb061ed service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received unexpected event network-vif-plugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 for instance with vm_state building and task_state spawning.
Nov 14 19:21:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:43 user nova-compute[75205]: INFO nova.compute.manager [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Rescuing
Nov 14 19:21:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquired lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:21:43 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:21:44 user nova-compute[75205]: DEBUG nova.network.neutron [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Updating instance_info_cache with network_info: [{"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Releasing lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:21:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Instance destroyed successfully.
Nov 14 19:21:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Attempting a stable device rescue
Nov 14 19:21:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75205) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Instance directory exists: not creating {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 19:21:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Creating image(s)
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "/opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "/opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1ec04cbd-a532-4e15-ba88-a87e6d41e249 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "525d54958ff64ee24fdc4fad67e4aed0a11b620b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "525d54958ff64ee24fdc4fad67e4aed0a11b620b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received event network-vif-plugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] Acquiring lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] No waiting events found dispatching network-vif-plugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:45 user nova-compute[75205]: WARNING nova.compute.manager [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received unexpected event network-vif-plugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 for instance with vm_state building and task_state spawning.
Nov 14 19:21:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:45 user nova-compute[75205]: WARNING nova.compute.manager [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state active and task_state rescuing.
Nov 14 19:21:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:45 user nova-compute[75205]: WARNING nova.compute.manager [req-0a01c056-7d8f-439e-a950-fc7328444449 req-1820dd70-956c-4372-aa3c-2a68978a98d5 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state active and task_state rescuing.
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b.part --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:21:46 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Instance spawned successfully.
Nov 14 19:21:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:21:46 user nova-compute[75205]: INFO nova.compute.manager [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 14 19:21:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b.part --force-share --output=json" returned: 0 in 0.216s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG nova.virt.images [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] 5029e7c7-955b-4944-8869-204eaa5f9550 was qcow2, converting to raw {{(pid=75205) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b.part /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b.converted {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:46 user nova-compute[75205]: INFO nova.compute.manager [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Took 18.81 seconds to build instance.
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ee4a2dde-94d8-45dd-a906-d45e7df37d91 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.923s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:46 user nova-compute[75205]: INFO nova.compute.manager [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Terminating instance
Nov 14 19:21:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b.part /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b.converted" returned: 0 in 0.222s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b.converted --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "525d54958ff64ee24fdc4fad67e4aed0a11b620b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.759s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "525d54958ff64ee24fdc4fad67e4aed0a11b620b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "525d54958ff64ee24fdc4fad67e4aed0a11b620b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb808b44-8c0e-477f-9e04-80141958dee7 req-a16cc623-63bb-4079-a120-970c49a2365e service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received event network-vif-unplugged-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb808b44-8c0e-477f-9e04-80141958dee7 req-a16cc623-63bb-4079-a120-970c49a2365e service nova] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb808b44-8c0e-477f-9e04-80141958dee7 req-a16cc623-63bb-4079-a120-970c49a2365e service nova] Lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb808b44-8c0e-477f-9e04-80141958dee7 req-a16cc623-63bb-4079-a120-970c49a2365e service nova] Lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb808b44-8c0e-477f-9e04-80141958dee7 req-a16cc623-63bb-4079-a120-970c49a2365e service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] No waiting events found dispatching network-vif-unplugged-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb808b44-8c0e-477f-9e04-80141958dee7 req-a16cc623-63bb-4079-a120-970c49a2365e service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received event network-vif-unplugged-0343e201-fc35-440c-9347-c394b44e22f6 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b --force-share --output=json" returned: 0 in 0.203s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b,backing_fmt=raw /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b,backing_fmt=raw /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue" returned: 0 in 0.093s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "525d54958ff64ee24fdc4fad67e4aed0a11b620b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'migration_context' on Instance uuid 1ec04cbd-a532-4e15-ba88-a87e6d41e249 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Object Instance<1ec04cbd-a532-4e15-ba88-a87e6d41e249> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Start _get_guest_xml network_info=[{"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "vif_mac": "fa:16:3e:53:48:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5029e7c7-955b-4944-8869-204eaa5f9550', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPxeWdfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1ec04cbd-a532-4e15-ba88-a87e6d41e249', 'attached_at': '', 'detached_at': '', 'volume_id': '616c6c6f-cd8b-44fb-8956-d010e71b92e0', 'serial': '616c6c6f-cd8b-44fb-8956-d010e71b92e0'}, 'attachment_id': 'aa836143-bae7-4eed-bf04-332eba26536a', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'resources' on Instance uuid 1ec04cbd-a532-4e15-ba88-a87e6d41e249 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-dbe2cd3b-8eff-4341-aacd-08ca0a10a00a req-58fbc663-f32c-4908-bb33-2a33994f1e11 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received event network-changed-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-dbe2cd3b-8eff-4341-aacd-08ca0a10a00a req-58fbc663-f32c-4908-bb33-2a33994f1e11 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Refreshing instance network info cache due to event network-changed-0343e201-fc35-440c-9347-c394b44e22f6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dbe2cd3b-8eff-4341-aacd-08ca0a10a00a req-58fbc663-f32c-4908-bb33-2a33994f1e11 service nova] Acquiring lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dbe2cd3b-8eff-4341-aacd-08ca0a10a00a req-58fbc663-f32c-4908-bb33-2a33994f1e11 service nova] Acquired lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.network.neutron [req-dbe2cd3b-8eff-4341-aacd-08ca0a10a00a req-58fbc663-f32c-4908-bb33-2a33994f1e11 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Refreshing network info cache for port 0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Object Instance<1ec04cbd-a532-4e15-ba88-a87e6d41e249> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'numa_topology' on Instance uuid 1ec04cbd-a532-4e15-ba88-a87e6d41e249 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Object Instance<1ec04cbd-a532-4e15-ba88-a87e6d41e249> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:21:47 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:21:47 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1ec04cbd-a532-4e15-ba88-a87e6d41e249 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Object Instance<1ec04cbd-a532-4e15-ba88-a87e6d41e249> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPxeWdfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:21:47 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:21:47 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:21:47 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdb79b0-8923-4821-b725-f7659f8e8b9a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kPxeWdfc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 19:21:47 user nova-compute[75205]: node.name = iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0
Nov 14 19:21:47 user nova-compute[75205]: node.tpgt = -1
Nov 14 19:21:47 user nova-compute[75205]: node.startup = automatic
Nov 14 19:21:47 user nova-compute[75205]: node.leading_login = No
Nov 14 19:21:47 user nova-compute[75205]: iface.iscsi_ifacename = default
Nov 14 19:21:47 user nova-compute[75205]: iface.net_ifacename = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.ipaddress = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.prefix_len = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.hwaddress = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.transport_name = tcp
Nov 14 19:21:47 user nova-compute[75205]: iface.initiatorname = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.state = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.vlan_id = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.vlan_priority = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.vlan_state = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.iface_num = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.mtu = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.port = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.bootproto = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.subnet_mask = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.gateway = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.dhcp_alt_client_id = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.dhcp_dns = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.dhcp_learn_iqn = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.dhcp_vendor_id_state = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.dhcp_vendor_id = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.dhcp_slp_da = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.fragmentation = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.gratuitous_arp = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.incoming_forwarding = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.tos_state = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.tos = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.ttl = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.delayed_ack = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.tcp_nagle = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.tcp_wsf_state = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.tcp_wsf = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.tcp_timer_scale = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.tcp_timestamp = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.redirect = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.def_task_mgmt_timeout = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.header_digest = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.data_digest = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.immediate_data = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.initial_r2t = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.data_seq_inorder = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.data_pdu_inorder = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.erl = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.max_receive_data_len = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.first_burst_len = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.max_outstanding_r2t = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.max_burst_len = 0
Nov 14 19:21:47 user nova-compute[75205]: iface.chap_auth = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.bidi_chap = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.strict_login_compliance = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.discovery_auth = <empty>
Nov 14 19:21:47 user nova-compute[75205]: iface.discovery_logout = <empty>
Nov 14 19:21:47 user nova-compute[75205]: node.discovery_address = <empty>
Nov 14 19:21:47 user nova-compute[75205]: node.discovery_port = 0
Nov 14 19:21:47 user nova-compute[75205]: node.discovery_type = static
Nov 14 19:21:47 user nova-compute[75205]: node.session.initial_cmdsn = 0
Nov 14 19:21:47 user nova-compute[75205]: node.session.initial_login_retry_max = 8
Nov 14 19:21:47 user nova-compute[75205]: node.session.xmit_thread_priority = -20
Nov 14 19:21:47 user nova-compute[75205]: node.session.cmds_max = 128
Nov 14 19:21:47 user nova-compute[75205]: node.session.queue_depth = 32
Nov 14 19:21:47 user nova-compute[75205]: node.session.nr_sessions = 1
Nov 14 19:21:47 user nova-compute[75205]: node.session.auth.authmethod = CHAP
Nov 14 19:21:47 user nova-compute[75205]: node.session.auth.username = kPxeWdfc
Nov 14 19:21:47 user nova-compute[75205]: node.session.auth.password = ***
Nov 14 19:21:47 user nova-compute[75205]: node.session.auth.username_in = <empty>
Nov 14 19:21:47 user nova-compute[75205]: node.session.auth.password_in = <empty>
Nov 14 19:21:47 user nova-compute[75205]: node.session.auth.chap_algs = MD5
Nov 14 19:21:47 user nova-compute[75205]: node.session.timeo.replacement_timeout = 120
Nov 14 19:21:47 user nova-compute[75205]: node.session.err_timeo.abort_timeout = 15
Nov 14 19:21:47 user nova-compute[75205]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 19:21:47 user nova-compute[75205]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 19:21:47 user nova-compute[75205]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 19:21:47 user nova-compute[75205]: node.session.iscsi.FastAbort = Yes
Nov 14 19:21:47 user nova-compute[75205]: node.session.iscsi.InitialR2T = No
Nov 14 19:21:47 user nova-compute[75205]: node.session.iscsi.ImmediateData = Yes
Nov 14 19:21:47 user nova-compute[75205]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 19:21:47 user nova-compute[75205]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 19:21:47 user nova-compute[75205]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 19:21:47 user nova-compute[75205]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 19:21:47 user nova-compute[75205]: node.session.iscsi.MaxConnections = 1
Nov 14 19:21:47 user nova-compute[75205]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 19:21:47 user nova-compute[75205]: node.session.iscsi.ERL = 0
Nov 14 19:21:47 user nova-compute[75205]: node.session.scan = manual
Nov 14 19:21:47 user nova-compute[75205]: node.session.reopen_max = 0
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].address = 172.16.0.220
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].port = 3260
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].startup = manual
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].tcp.window_size = 524288
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].tcp.type_of_service = 0
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].timeo.logout_timeout = 15
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].timeo.login_timeout = 15
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].timeo.auth_timeout = 45
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].iscsi.DataDigest = None
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].iscsi.IFMarker = No
Nov 14 19:21:47 user nova-compute[75205]: node.conn[0].iscsi.OFMarker = No
Nov 14 19:21:47 user nova-compute[75205]: # END RECORD
Nov 14 19:21:47 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[881853a4-f95e-4aa7-91a5-53ec3187fdf6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c0650d-67ab-4df8-b2a8-6f97a5855111]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPxeWdfc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPxeWdfc" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b150d0-aa2a-4778-b6a2-6976e04b5616]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPxeWdfc'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6ba6e1-0c94-44ed-b726-8d2532beba64]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfea4f39-363d-4816-b914-b68995a66f6b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:21:47 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:21:47 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:21:47 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:21:47 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:21:47 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:21:47 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:21:47 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:21:47 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:21:47 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:21:47 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:21:47 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:21:47 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] HCTL ('35', '0', '0', 0) found on session 35 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbc82e7-ac3d-4a55-88f1-b28ebd3c2055]: (4, ('0 0 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Searching for a device in session 35 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPxeWdfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '26436366362376531', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436366362376531', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:21:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Instance destroyed successfully.
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.instance [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lazy-loading 'resources' on Instance uuid 6864c442-8284-4dd8-8165-ff891e5d5175 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1023753886',display_name='tempest-TestStampPattern-server-1023753886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1023753886',id=20,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd1svgJTYybDPh1lPR3DIJKAtUs1FjktJwKG4A3pEzS7EJ21cmmx2eyxvLZzWkBvHvPEmdFTD/HrC2z/t88W02YyxzcpPr7NmabWOAd9mQhAqkZ+Jzq7r3Uf9KQEyTcwQ==',key_name='tempest-TestStampPattern-1251953881',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:14:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84244ff590a4bcaae6cc065b21cb12f',ramdisk_id='',reservation_id='r-5t00kcmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-719339764',owner_user_name='tempest-TestStampPattern-719339764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:17:04Z,user_data=None,user_id='67f99408d4954514aebc9d616ec5bcf0',uuid=6864c442-8284-4dd8-8165-ff891e5d5175,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converting VIF {"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:58:e5,bridge_name='br-int',has_traffic_filtering=True,id=0343e201-fc35-440c-9347-c394b44e22f6,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0343e201-fc') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG os_vif [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:58:e5,bridge_name='br-int',has_traffic_filtering=True,id=0343e201-fc35-440c-9347-c394b44e22f6,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0343e201-fc') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1344472545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1344472545',id=31,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:20:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-rf8l979h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:20:19Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=1ec04cbd-a532-4e15-ba88-a87e6d41e249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "vif_mac": "fa:16:3e:53:48:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "vif_mac": "fa:16:3e:53:48:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:48:58,bridge_name='br-int',has_traffic_filtering=True,id=ad5f1ef2-ebe2-4f5f-8777-891848473af2,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5f1ef2-eb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ec04cbd-a532-4e15-ba88-a87e6d41e249 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0343e201-fc, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.objects.base [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Object Instance<1ec04cbd-a532-4e15-ba88-a87e6d41e249> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:21:47 user nova-compute[75205]:   <uuid>1ec04cbd-a532-4e15-ba88-a87e6d41e249</uuid>
Nov 14 19:21:47 user nova-compute[75205]:   <name>instance-0000001f</name>
Nov 14 19:21:47 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:21:47 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:21:47 user nova-compute[75205]:   <metadata>
Nov 14 19:21:47 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:21:47 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:21:47 user nova-compute[75205]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1344472545</nova:name>
Nov 14 19:21:47 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:21:47</nova:creationTime>
Nov 14 19:21:47 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:21:47 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:21:47 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:21:47 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:21:47 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:21:47 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:21:47 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:21:47 user nova-compute[75205]:       <nova:owner>
Nov 14 19:21:47 user nova-compute[75205]:         <nova:user uuid="d0ee9d2093e64175b45b3b4d99b5648f">tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member</nova:user>
Nov 14 19:21:47 user nova-compute[75205]:         <nova:project uuid="fde587867310451cab4f464b330555af">tempest-ServerBootFromVolumeStableRescueTest-2146587572</nova:project>
Nov 14 19:21:47 user nova-compute[75205]:       </nova:owner>
Nov 14 19:21:47 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:21:47 user nova-compute[75205]:       <nova:ports>
Nov 14 19:21:47 user nova-compute[75205]:         <nova:port uuid="ad5f1ef2-ebe2-4f5f-8777-891848473af2">
Nov 14 19:21:47 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 19:21:47 user nova-compute[75205]:         </nova:port>
Nov 14 19:21:47 user nova-compute[75205]:       </nova:ports>
Nov 14 19:21:47 user nova-compute[75205]:     </nova:instance>
Nov 14 19:21:47 user nova-compute[75205]:   </metadata>
Nov 14 19:21:47 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:21:47 user nova-compute[75205]:     <system>
Nov 14 19:21:47 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:21:47 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:21:47 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:21:47 user nova-compute[75205]:       <entry name="serial">1ec04cbd-a532-4e15-ba88-a87e6d41e249</entry>
Nov 14 19:21:47 user nova-compute[75205]:       <entry name="uuid">1ec04cbd-a532-4e15-ba88-a87e6d41e249</entry>
Nov 14 19:21:47 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:21:47 user nova-compute[75205]:     </system>
Nov 14 19:21:47 user nova-compute[75205]:   </sysinfo>
Nov 14 19:21:47 user nova-compute[75205]:   <os>
Nov 14 19:21:47 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:21:47 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:21:47 user nova-compute[75205]:   </os>
Nov 14 19:21:47 user nova-compute[75205]:   <features>
Nov 14 19:21:47 user nova-compute[75205]:     <acpi/>
Nov 14 19:21:47 user nova-compute[75205]:     <apic/>
Nov 14 19:21:47 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:21:47 user nova-compute[75205]:   </features>
Nov 14 19:21:47 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:21:47 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:21:47 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:21:47 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:21:47 user nova-compute[75205]:   </clock>
Nov 14 19:21:47 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:21:47 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:21:47 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:21:47 user nova-compute[75205]:   </cpu>
Nov 14 19:21:47 user nova-compute[75205]:   <devices>
Nov 14 19:21:47 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:21:47 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:21:47 user nova-compute[75205]:       <source dev="/dev/sdd"/>
Nov 14 19:21:47 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:21:47 user nova-compute[75205]:       <serial>616c6c6f-cd8b-44fb-8956-d010e71b92e0</serial>
Nov 14 19:21:47 user nova-compute[75205]:     </disk>
Nov 14 19:21:47 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:21:47 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:21:47 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue"/>
Nov 14 19:21:47 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:21:47 user nova-compute[75205]:       <boot order="1"/>
Nov 14 19:21:47 user nova-compute[75205]:     </disk>
Nov 14 19:21:47 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:21:47 user nova-compute[75205]:       <mac address="fa:16:3e:53:48:58"/>
Nov 14 19:21:47 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:21:47 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:21:47 user nova-compute[75205]:       <target dev="tapad5f1ef2-eb"/>
Nov 14 19:21:47 user nova-compute[75205]:     </interface>
Nov 14 19:21:47 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:21:47 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/console.log" append="off"/>
Nov 14 19:21:47 user nova-compute[75205]:     </serial>
Nov 14 19:21:47 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:21:47 user nova-compute[75205]:     <video>
Nov 14 19:21:47 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:21:47 user nova-compute[75205]:     </video>
Nov 14 19:21:47 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:21:47 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:21:47 user nova-compute[75205]:     </rng>
Nov 14 19:21:47 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:21:47 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:21:47 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:21:47 user nova-compute[75205]:     </memballoon>
Nov 14 19:21:47 user nova-compute[75205]:   </devices>
Nov 14 19:21:47 user nova-compute[75205]: </domain>
Nov 14 19:21:47 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0b34120-af11-479d-9afe-4d2a6df2564b) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:47 user nova-compute[75205]: INFO os_vif [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:58:e5,bridge_name='br-int',has_traffic_filtering=True,id=0343e201-fc35-440c-9347-c394b44e22f6,network=Network(1e2420b5-fc73-4462-a3de-87d90cb1b21a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0343e201-fc')
Nov 14 19:21:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Deleting instance files /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175_del
Nov 14 19:21:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Deletion of /opt/stack/data/nova/instances/6864c442-8284-4dd8-8165-ff891e5d5175_del complete
Nov 14 19:21:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Instance destroyed successfully.
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] No VIF found with MAC fa:16:3e:53:48:58, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:21:47 user nova-compute[75205]: INFO nova.compute.manager [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.network.neutron [req-dbe2cd3b-8eff-4341-aacd-08ca0a10a00a req-58fbc663-f32c-4908-bb33-2a33994f1e11 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updated VIF entry in instance network info cache for port 0343e201-fc35-440c-9347-c394b44e22f6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG nova.network.neutron [req-dbe2cd3b-8eff-4341-aacd-08ca0a10a00a req-58fbc663-f32c-4908-bb33-2a33994f1e11 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updating instance_info_cache with network_info: [{"id": "0343e201-fc35-440c-9347-c394b44e22f6", "address": "fa:16:3e:55:58:e5", "network": {"id": "1e2420b5-fc73-4462-a3de-87d90cb1b21a", "bridge": "br-int", "label": "tempest-TestStampPattern-403812333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84244ff590a4bcaae6cc065b21cb12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0343e201-fc", "ovs_interfaceid": "0343e201-fc35-440c-9347-c394b44e22f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dbe2cd3b-8eff-4341-aacd-08ca0a10a00a req-58fbc663-f32c-4908-bb33-2a33994f1e11 service nova] Releasing lock "refresh_cache-6864c442-8284-4dd8-8165-ff891e5d5175" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:21:48 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:48 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Took 0.46 seconds to deallocate network for instance.
Nov 14 19:21:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:48 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:21:48 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:21:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:48 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Deleted allocations for instance 6864c442-8284-4dd8-8165-ff891e5d5175
Nov 14 19:21:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d4ca992-8092-4b53-9f66-923b41b54847 tempest-TestStampPattern-719339764 tempest-TestStampPattern-719339764-project-member] Lock "6864c442-8284-4dd8-8165-ff891e5d5175" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.187s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-7afe3bdb-6db1-40c3-9db8-eeaa768a8fde req-e9d0ec09-65b4-4890-8f62-74bd12f9b9a7 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received event network-vif-plugged-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7afe3bdb-6db1-40c3-9db8-eeaa768a8fde req-e9d0ec09-65b4-4890-8f62-74bd12f9b9a7 service nova] Acquiring lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7afe3bdb-6db1-40c3-9db8-eeaa768a8fde req-e9d0ec09-65b4-4890-8f62-74bd12f9b9a7 service nova] Lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7afe3bdb-6db1-40c3-9db8-eeaa768a8fde req-e9d0ec09-65b4-4890-8f62-74bd12f9b9a7 service nova] Lock "6864c442-8284-4dd8-8165-ff891e5d5175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-7afe3bdb-6db1-40c3-9db8-eeaa768a8fde req-e9d0ec09-65b4-4890-8f62-74bd12f9b9a7 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] No waiting events found dispatching network-vif-plugged-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:49 user nova-compute[75205]: WARNING nova.compute.manager [req-7afe3bdb-6db1-40c3-9db8-eeaa768a8fde req-e9d0ec09-65b4-4890-8f62-74bd12f9b9a7 service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received unexpected event network-vif-plugged-0343e201-fc35-440c-9347-c394b44e22f6 for instance with vm_state deleted and task_state None.
Nov 14 19:21:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-5af37c0c-382f-4339-b257-88238d996c2d req-a89eea47-b303-4f55-af6f-ef26c70eb55c service nova] [instance: 6864c442-8284-4dd8-8165-ff891e5d5175] Received event network-vif-deleted-0343e201-fc35-440c-9347-c394b44e22f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-5af37c0c-382f-4339-b257-88238d996c2d req-a89eea47-b303-4f55-af6f-ef26c70eb55c service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5af37c0c-382f-4339-b257-88238d996c2d req-a89eea47-b303-4f55-af6f-ef26c70eb55c service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5af37c0c-382f-4339-b257-88238d996c2d req-a89eea47-b303-4f55-af6f-ef26c70eb55c service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5af37c0c-382f-4339-b257-88238d996c2d req-a89eea47-b303-4f55-af6f-ef26c70eb55c service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-5af37c0c-382f-4339-b257-88238d996c2d req-a89eea47-b303-4f55-af6f-ef26c70eb55c service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:49 user nova-compute[75205]: WARNING nova.compute.manager [req-5af37c0c-382f-4339-b257-88238d996c2d req-a89eea47-b303-4f55-af6f-ef26c70eb55c service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state active and task_state rescuing.
Nov 14 19:21:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e4e58204-ec94-4037-aa0f-8dbdbe73834b tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:21:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-7731c881-03e3-4eea-8abe-b0973d65cd9d req-75790971-02ae-4759-aa5c-59aecbe45f69 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7731c881-03e3-4eea-8abe-b0973d65cd9d req-75790971-02ae-4759-aa5c-59aecbe45f69 service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7731c881-03e3-4eea-8abe-b0973d65cd9d req-75790971-02ae-4759-aa5c-59aecbe45f69 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7731c881-03e3-4eea-8abe-b0973d65cd9d req-75790971-02ae-4759-aa5c-59aecbe45f69 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-7731c881-03e3-4eea-8abe-b0973d65cd9d req-75790971-02ae-4759-aa5c-59aecbe45f69 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:51 user nova-compute[75205]: WARNING nova.compute.manager [req-7731c881-03e3-4eea-8abe-b0973d65cd9d req-75790971-02ae-4759-aa5c-59aecbe45f69 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state active and task_state rescuing.
Nov 14 19:21:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:53 user nova-compute[75205]: INFO nova.compute.manager [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Terminating instance
Nov 14 19:21:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-751ee611-f33f-4a37-a392-53a653d4cd92 req-fe11574f-50f1-423f-9b48-6cfc2400d969 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-unplugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-751ee611-f33f-4a37-a392-53a653d4cd92 req-fe11574f-50f1-423f-9b48-6cfc2400d969 service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-751ee611-f33f-4a37-a392-53a653d4cd92 req-fe11574f-50f1-423f-9b48-6cfc2400d969 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-751ee611-f33f-4a37-a392-53a653d4cd92 req-fe11574f-50f1-423f-9b48-6cfc2400d969 service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-751ee611-f33f-4a37-a392-53a653d4cd92 req-fe11574f-50f1-423f-9b48-6cfc2400d969 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-unplugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-751ee611-f33f-4a37-a392-53a653d4cd92 req-fe11574f-50f1-423f-9b48-6cfc2400d969 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-unplugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:21:54 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Instance destroyed successfully.
Nov 14 19:21:54 user nova-compute[75205]: DEBUG nova.objects.instance [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lazy-loading 'resources' on Instance uuid c7744d82-c045-4602-9d7a-83f7d331a77e {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1772840421',display_name='tempest-ServerActionsTestOtherB-server-1772840421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1772840421',id=19,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUvKLnxFaWKfqQ4S/vwP+KIMyYqWAdaytSw3dniXzUF4xEGN7HlZuv7hGHWqxL9ir7W3jD5e9NmeSnZ82sU02gBYwBF2DuOPl6Jkk6gX2AGI1xcTXp5bR0/Q/rxf2ub4A==',key_name='tempest-keypair-444037287',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41ef713467204951b8d5433d80805441',ramdisk_id='',reservation_id='r-5k36qfa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-938366899',owner_user_name='tempest-ServerActionsTestOtherB-938366899-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:19:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614f7aa49ee045c1a3cd9d23cb6bdebe',uuid=c7744d82-c045-4602-9d7a-83f7d331a77e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converting VIF {"id": "814f09b6-754e-4e78-947a-6a7c488019e0", "address": "fa:16:3e:c6:53:01", "network": {"id": "637a663d-b0ca-4ab0-bd25-c4e6edea8248", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-862995617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ef713467204951b8d5433d80805441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f09b6-75", "ovs_interfaceid": "814f09b6-754e-4e78-947a-6a7c488019e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_vif [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap814f09b6-75, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b92b0941-1fbc-4abe-899b-90ec5746976f) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:21:54 user nova-compute[75205]: INFO os_vif [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:53:01,bridge_name='br-int',has_traffic_filtering=True,id=814f09b6-754e-4e78-947a-6a7c488019e0,network=Network(637a663d-b0ca-4ab0-bd25-c4e6edea8248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f09b6-75')
Nov 14 19:21:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpBCfcvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:21:54 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd46db2-68e2-4136-9b98-22883f534939]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:21:54 user nova-compute[75205]: No targets found.
Nov 14 19:21:54 user nova-compute[75205]: iSNS:
Nov 14 19:21:54 user nova-compute[75205]: No targets found.
Nov 14 19:21:54 user nova-compute[75205]: STATIC:
Nov 14 19:21:54 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a
Nov 14 19:21:54 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:54 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:54 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:21:54 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:54 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:54 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5
Nov 14 19:21:54 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:54 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:54 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96
Nov 14 19:21:54 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:54 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:54 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d
Nov 14 19:21:54 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:54 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:54 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0
Nov 14 19:21:54 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:21:54 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:21:54 user nova-compute[75205]: FIRMWARE:
Nov 14 19:21:54 user nova-compute[75205]: No targets found.
Nov 14 19:21:54 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:21:54 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:21:54 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6685ad5f-aa88-4568-ad65-5ca3f3749c76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27f295f-4526-4402-8bb9-d8451374cd3a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:21:54 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:21:54 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:21:54 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:21:54 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:21:54 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:21:54 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:21:54 user nova-compute[75205]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 (non-flash)
Nov 14 19:21:54 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:21:54 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:21:54 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:21:54 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:21:54 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb741475b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96'): ({'sdg'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Removing single pathed devices sdg {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d84d85-566f-4910-9d9c-7ed95b9199ff]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2402db1d-546a-4f68-a6b5-554e38dbfa3a]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Flushing IO for device /dev/sdg {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[170c8f88-81ba-4e33-ae54-865c50e5bb40]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fbb8cf-bb7b-4769-bc36-6ed61c7a58d2]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] SCSI volumes sdg have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afb3751-8412-4b85-bc75-351419ae5472]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cbdea8-0c26-4441-86b2-f5ff5726bc75]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260]
Nov 14 19:21:54 user nova-compute[75205]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96, portal: 172.16.0.220,3260] successful.
Nov 14 19:21:54 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e61131b2-12a0-4593-85bd-155d9fcc8c96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c5e651-6c82-45b7-8d37-b92591dbda95]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] <== disconnect_volume: return (316ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:21:54 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Deleting instance files /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e_del
Nov 14 19:21:54 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Deletion of /opt/stack/data/nova/instances/c7744d82-c045-4602-9d7a-83f7d331a77e_del complete
Nov 14 19:21:54 user nova-compute[75205]: INFO nova.compute.manager [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 14 19:21:54 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:21:54 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:21:55 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:21:55 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Took 0.80 seconds to deallocate network for instance.
Nov 14 19:21:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-bad7b481-877e-4bcf-8bed-e12b91201ec2 req-d84605f6-2b75-4f40-ba4a-09e371ed9ba9 service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-deleted-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:56 user nova-compute[75205]: DEBUG nova.compute.manager [req-bb9c83d1-c94e-4c3b-a4a0-83734b9e367c req-cc0f7fe1-910d-49aa-8d1a-e2cd8933f62f service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:21:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bb9c83d1-c94e-4c3b-a4a0-83734b9e367c req-cc0f7fe1-910d-49aa-8d1a-e2cd8933f62f service nova] Acquiring lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bb9c83d1-c94e-4c3b-a4a0-83734b9e367c req-cc0f7fe1-910d-49aa-8d1a-e2cd8933f62f service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-bb9c83d1-c94e-4c3b-a4a0-83734b9e367c req-cc0f7fe1-910d-49aa-8d1a-e2cd8933f62f service nova] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:56 user nova-compute[75205]: DEBUG nova.compute.manager [req-bb9c83d1-c94e-4c3b-a4a0-83734b9e367c req-cc0f7fe1-910d-49aa-8d1a-e2cd8933f62f service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] No waiting events found dispatching network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:21:56 user nova-compute[75205]: WARNING nova.compute.manager [req-bb9c83d1-c94e-4c3b-a4a0-83734b9e367c req-cc0f7fe1-910d-49aa-8d1a-e2cd8933f62f service nova] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Received unexpected event network-vif-plugged-814f09b6-754e-4e78-947a-6a7c488019e0 for instance with vm_state active and task_state deleting.
Nov 14 19:21:56 user nova-compute[75205]: INFO nova.compute.manager [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] [instance: c7744d82-c045-4602-9d7a-83f7d331a77e] Took 0.82 seconds to detach 1 volumes for instance.
Nov 14 19:21:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:21:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:21:56 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:21:56 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:21:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:56 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Deleted allocations for instance c7744d82-c045-4602-9d7a-83f7d331a77e
Nov 14 19:21:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-65d3a4b4-41b0-40cc-a448-0c1a75de9baa tempest-ServerActionsTestOtherB-938366899 tempest-ServerActionsTestOtherB-938366899-project-member] Lock "c7744d82-c045-4602-9d7a-83f7d331a77e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.452s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:21:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:21:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:30 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:22:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:22:31 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:22:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:35 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:22:35 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7284MB free_disk=24.96192169189453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2a32bb26-deb4-407d-a9e9-31de887e0b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d1a77658-d712-402d-b67b-322751e2f202 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1ec04cbd-a532-4e15-ba88-a87e6d41e249 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7baa5285-c30b-451c-ab03-ce78ee2c498d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:22:35 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:22:36 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:22:36 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:22:36 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:22:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:37 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:22:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:22:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:22:37 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:22:37 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:22:37 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:22:37 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:22:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:22:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:22:39 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:22:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-b9998a29-69ce-4a01-a623-9686f51a4044 req-284d846e-9f99-47d9-9e69-4ee989581330 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-changed-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-b9998a29-69ce-4a01-a623-9686f51a4044 req-284d846e-9f99-47d9-9e69-4ee989581330 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Refreshing instance network info cache due to event network-changed-ee66e456-9848-4460-ad8d-4a5be982c145. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b9998a29-69ce-4a01-a623-9686f51a4044 req-284d846e-9f99-47d9-9e69-4ee989581330 service nova] Acquiring lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b9998a29-69ce-4a01-a623-9686f51a4044 req-284d846e-9f99-47d9-9e69-4ee989581330 service nova] Acquired lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-b9998a29-69ce-4a01-a623-9686f51a4044 req-284d846e-9f99-47d9-9e69-4ee989581330 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Refreshing network info cache for port ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'flavor' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-b9998a29-69ce-4a01-a623-9686f51a4044 req-284d846e-9f99-47d9-9e69-4ee989581330 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updated VIF entry in instance network info cache for port ee66e456-9848-4460-ad8d-4a5be982c145. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-b9998a29-69ce-4a01-a623-9686f51a4044 req-284d846e-9f99-47d9-9e69-4ee989581330 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updating instance_info_cache with network_info: [{"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b9998a29-69ce-4a01-a623-9686f51a4044 req-284d846e-9f99-47d9-9e69-4ee989581330 service nova] Releasing lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:43 user nova-compute[75205]: INFO nova.compute.manager [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Attaching volume 98620305-f4c7-4522-bf70-8502b5b3a8e4 to /dev/vdb
Nov 14 19:22:44 user nova-compute[75205]: DEBUG os_brick.utils [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3cc05d-de94-4d93-86c0-02f79f7e1c15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa272e2-a4e9-4752-aa6c-1958af45ef08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0655104e-5a56-419e-bb8c-19a50d7851e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6094f16-5ec0-469a-a2e3-e4871879d48f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:22:44 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:22:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8404307b-0c04-4aeb-abb8-0da9f30c2e10]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG os_brick.utils [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updating existing volume attachment record: 988c0a46-b3be-4e97-abca-7868d8ffddf3 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:22:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLUJiuhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:22:48 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:22:48 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:22:48 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ee1d58-fc9b-4de6-b1ec-f66190ca8391]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:22:48 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5ba062-1929-4b59-817e-5b0ef74f210d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4] added
Nov 14 19:22:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d19ddf-3b9f-4cf2-9e67-2e7eb685ccd8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc212804-5f97-42fd-a0f2-23eec0c3597b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YLUJiuhs {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YLUJiuhs" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c18a604-07b1-4d8f-8490-ab7fe0b7522c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YLUJiuhs'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[faacd476-af0e-4a86-beb5-848d69b71ebb]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[013178ec-7be1-4641-abde-ebe1ac1fcdc9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:22:48 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:22:48 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:22:48 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:22:48 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:22:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:22:48 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:22:48 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:22:48 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:22:48 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:22:48 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:22:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b835f94c-a676-4343-8a7b-a3640f34a6d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4, portal: 172.16.0.220,3260]
Nov 14 19:22:49 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4, portal: 172.16.0.220,3260] successful.
Nov 14 19:22:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5a9c82-6b4c-4f97-ab2d-1a42933c3793]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c47d1f9-1353-45c8-9fb2-8e434c1a798b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:22:49 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:22:49 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:22:49 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:22:49 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:22:49 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:22:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:22:49 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:22:49 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:22:49 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:22:49 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:22:49 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:22:49 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dfa2fd-c160-4021-8b5a-0dc8622f59e0]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLUJiuhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:22:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:22:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23533356632663764', 'path': '/dev/sdg'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:22:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533356632663764', 'path': '/dev/sdg'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:22:50 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'flavor' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:22:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:22:50 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:22:50 user nova-compute[75205]:   <source dev="/dev/sdg"/>
Nov 14 19:22:50 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:22:50 user nova-compute[75205]:   <serial>98620305-f4c7-4522-bf70-8502b5b3a8e4</serial>
Nov 14 19:22:50 user nova-compute[75205]: </disk>
Nov 14 19:22:50 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:22:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:22:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:22:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No VIF found with MAC fa:16:3e:a3:31:45, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:22:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0f9a5356-76df-4918-9e50-f6450abeed39 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.724s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:51 user nova-compute[75205]: INFO nova.compute.manager [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Rescuing
Nov 14 19:22:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:22:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquired lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:22:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:22:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:52 user nova-compute[75205]: DEBUG nova.network.neutron [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updating instance_info_cache with network_info: [{"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:22:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Releasing lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:22:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:52 user nova-compute[75205]: DEBUG nova.compute.manager [req-35ec7035-92a5-4198-ba26-ec3529dcbe34 req-59ce40bc-8a68-4fa2-85b5-4643d1ddcd22 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-unplugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:22:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35ec7035-92a5-4198-ba26-ec3529dcbe34 req-59ce40bc-8a68-4fa2-85b5-4643d1ddcd22 service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35ec7035-92a5-4198-ba26-ec3529dcbe34 req-59ce40bc-8a68-4fa2-85b5-4643d1ddcd22 service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35ec7035-92a5-4198-ba26-ec3529dcbe34 req-59ce40bc-8a68-4fa2-85b5-4643d1ddcd22 service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:52 user nova-compute[75205]: DEBUG nova.compute.manager [req-35ec7035-92a5-4198-ba26-ec3529dcbe34 req-59ce40bc-8a68-4fa2-85b5-4643d1ddcd22 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-unplugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:22:52 user nova-compute[75205]: WARNING nova.compute.manager [req-35ec7035-92a5-4198-ba26-ec3529dcbe34 req-59ce40bc-8a68-4fa2-85b5-4643d1ddcd22 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-unplugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state active and task_state rescuing.
Nov 14 19:22:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Instance destroyed successfully.
Nov 14 19:22:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Attempting rescue
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75205) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Instance directory exists: not creating {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 19:22:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Creating image(s)
Nov 14 19:22:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue" returned: 0 in 0.047s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'migration_context' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.base [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<3ff88760-fa4a-4e52-a23e-6c60f54394cd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Start _get_guest_xml network_info=[{"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "vif_mac": "fa:16:3e:a3:31:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'resources' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.base [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<3ff88760-fa4a-4e52-a23e-6c60f54394cd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'numa_topology' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.base [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<3ff88760-fa4a-4e52-a23e-6c60f54394cd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:22:53 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:22:53 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.base [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<3ff88760-fa4a-4e52-a23e-6c60f54394cd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1382296437',display_name='tempest-ServerRescueNegativeTestJSON-server-1382296437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1382296437',id=32,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx4U+t4jtcgjmgFSJ+v+lTnWYR1BloB+eFgId25+qWaPBz41M/IStX7CJqL/vVNvD/TTJe7ZN6ebYa12QO6g9be/g1oyxCRNR9IfGtvmBsLdSzXlSfhLhDcm/EPZ0vNlw==',key_name='tempest-keypair-729185892',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:20:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-2t2akl9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b03af1014734b1a8d4c2633756070e8',uuid=3ff88760-fa4a-4e52-a23e-6c60f54394cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "vif_mac": "fa:16:3e:a3:31:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "vif_mac": "fa:16:3e:a3:31:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:31:45,bridge_name='br-int',has_traffic_filtering=True,id=ee66e456-9848-4460-ad8d-4a5be982c145,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee66e456-98') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.objects.base [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Object Instance<3ff88760-fa4a-4e52-a23e-6c60f54394cd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:22:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:22:53 user nova-compute[75205]:   <uuid>3ff88760-fa4a-4e52-a23e-6c60f54394cd</uuid>
Nov 14 19:22:53 user nova-compute[75205]:   <name>instance-00000020</name>
Nov 14 19:22:53 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:22:53 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:22:53 user nova-compute[75205]:   <metadata>
Nov 14 19:22:53 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:22:53 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:22:53 user nova-compute[75205]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1382296437</nova:name>
Nov 14 19:22:53 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:22:53</nova:creationTime>
Nov 14 19:22:53 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:22:53 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:22:53 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:22:53 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:22:53 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:22:53 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:22:53 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:22:53 user nova-compute[75205]:       <nova:owner>
Nov 14 19:22:53 user nova-compute[75205]:         <nova:user uuid="1b03af1014734b1a8d4c2633756070e8">tempest-ServerRescueNegativeTestJSON-278369752-project-member</nova:user>
Nov 14 19:22:53 user nova-compute[75205]:         <nova:project uuid="7eabb88364cd4173ba71aa8920d40954">tempest-ServerRescueNegativeTestJSON-278369752</nova:project>
Nov 14 19:22:53 user nova-compute[75205]:       </nova:owner>
Nov 14 19:22:53 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:22:53 user nova-compute[75205]:       <nova:ports>
Nov 14 19:22:53 user nova-compute[75205]:         <nova:port uuid="ee66e456-9848-4460-ad8d-4a5be982c145">
Nov 14 19:22:53 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:22:53 user nova-compute[75205]:         </nova:port>
Nov 14 19:22:53 user nova-compute[75205]:       </nova:ports>
Nov 14 19:22:53 user nova-compute[75205]:     </nova:instance>
Nov 14 19:22:53 user nova-compute[75205]:   </metadata>
Nov 14 19:22:53 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:22:53 user nova-compute[75205]:     <system>
Nov 14 19:22:53 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:22:53 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:22:53 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:22:53 user nova-compute[75205]:       <entry name="serial">3ff88760-fa4a-4e52-a23e-6c60f54394cd</entry>
Nov 14 19:22:53 user nova-compute[75205]:       <entry name="uuid">3ff88760-fa4a-4e52-a23e-6c60f54394cd</entry>
Nov 14 19:22:53 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:22:53 user nova-compute[75205]:     </system>
Nov 14 19:22:53 user nova-compute[75205]:   </sysinfo>
Nov 14 19:22:53 user nova-compute[75205]:   <os>
Nov 14 19:22:53 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:22:53 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:22:53 user nova-compute[75205]:   </os>
Nov 14 19:22:53 user nova-compute[75205]:   <features>
Nov 14 19:22:53 user nova-compute[75205]:     <acpi/>
Nov 14 19:22:53 user nova-compute[75205]:     <apic/>
Nov 14 19:22:53 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:22:53 user nova-compute[75205]:   </features>
Nov 14 19:22:53 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:22:53 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:22:53 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:22:53 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:22:53 user nova-compute[75205]:   </clock>
Nov 14 19:22:53 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:22:53 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:22:53 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:22:53 user nova-compute[75205]:   </cpu>
Nov 14 19:22:53 user nova-compute[75205]:   <devices>
Nov 14 19:22:53 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:22:53 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:22:53 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue"/>
Nov 14 19:22:53 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:22:53 user nova-compute[75205]:     </disk>
Nov 14 19:22:53 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:22:53 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:22:53 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk"/>
Nov 14 19:22:53 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:22:53 user nova-compute[75205]:     </disk>
Nov 14 19:22:53 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:22:53 user nova-compute[75205]:       <mac address="fa:16:3e:a3:31:45"/>
Nov 14 19:22:53 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:22:53 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:22:53 user nova-compute[75205]:       <target dev="tapee66e456-98"/>
Nov 14 19:22:53 user nova-compute[75205]:     </interface>
Nov 14 19:22:53 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:22:53 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/console.log" append="off"/>
Nov 14 19:22:53 user nova-compute[75205]:     </serial>
Nov 14 19:22:53 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:22:53 user nova-compute[75205]:     <video>
Nov 14 19:22:53 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:22:53 user nova-compute[75205]:     </video>
Nov 14 19:22:53 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:22:53 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:22:53 user nova-compute[75205]:     </rng>
Nov 14 19:22:53 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:22:53 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:22:53 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:22:53 user nova-compute[75205]:     </memballoon>
Nov 14 19:22:53 user nova-compute[75205]:   </devices>
Nov 14 19:22:53 user nova-compute[75205]: </domain>
Nov 14 19:22:53 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:22:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Instance destroyed successfully.
Nov 14 19:22:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:22:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:22:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] No VIF found with MAC fa:16:3e:a3:31:45, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:22:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-7f849216-93f4-475a-8533-d568b59df6a5 req-bc676383-4684-4cb6-9e9b-2c816db578cd service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:22:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7f849216-93f4-475a-8533-d568b59df6a5 req-bc676383-4684-4cb6-9e9b-2c816db578cd service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7f849216-93f4-475a-8533-d568b59df6a5 req-bc676383-4684-4cb6-9e9b-2c816db578cd service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7f849216-93f4-475a-8533-d568b59df6a5 req-bc676383-4684-4cb6-9e9b-2c816db578cd service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-7f849216-93f4-475a-8533-d568b59df6a5 req-bc676383-4684-4cb6-9e9b-2c816db578cd service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:22:55 user nova-compute[75205]: WARNING nova.compute.manager [req-7f849216-93f4-475a-8533-d568b59df6a5 req-bc676383-4684-4cb6-9e9b-2c816db578cd service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state active and task_state rescuing.
Nov 14 19:22:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:22:57 user nova-compute[75205]: WARNING nova.compute.manager [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state active and task_state rescuing.
Nov 14 19:22:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:22:57 user nova-compute[75205]: WARNING nova.compute.manager [req-f5062f0d-b47b-4197-9085-da591c09808b req-91b69b32-14e7-4893-a0dc-ccd8badf0157 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state active and task_state rescuing.
Nov 14 19:22:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0310fc7b-87d6-44e7-a41c-f71574eadcf4 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "7260ad81-fc37-4726-8fee-9adecb58040f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "7260ad81-fc37-4726-8fee-9adecb58040f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:57 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:22:57 user nova-compute[75205]: INFO nova.compute.claims [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Claim successful on node user
Nov 14 19:22:58 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:22:58 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:22:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG nova.policy [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '406f12b163cb4a989209213026aae994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80601810103b45acaf3c28a876fb51d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:22:58 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Creating image(s)
Nov 14 19:22:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "/opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "/opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "/opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Successfully created port: 706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk 1073741824" returned: 0 in 0.056s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.205s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Cannot resize image /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Ensure instance console log exists: /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:22:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Successfully updated port: 706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "refresh_cache-7260ad81-fc37-4726-8fee-9adecb58040f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquired lock "refresh_cache-7260ad81-fc37-4726-8fee-9adecb58040f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-245e764f-5448-4ae2-89bf-e6fd5d61f2c8 req-4a27b3bb-a803-4d2d-adc2-7f1cf2f394ac service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Received event network-changed-706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-245e764f-5448-4ae2-89bf-e6fd5d61f2c8 req-4a27b3bb-a803-4d2d-adc2-7f1cf2f394ac service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Refreshing instance network info cache due to event network-changed-706a5e48-f3b1-445d-b039-930e1ace4068. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-245e764f-5448-4ae2-89bf-e6fd5d61f2c8 req-4a27b3bb-a803-4d2d-adc2-7f1cf2f394ac service nova] Acquiring lock "refresh_cache-7260ad81-fc37-4726-8fee-9adecb58040f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.network.neutron [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Updating instance_info_cache with network_info: [{"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Releasing lock "refresh_cache-7260ad81-fc37-4726-8fee-9adecb58040f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Instance network_info: |[{"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-245e764f-5448-4ae2-89bf-e6fd5d61f2c8 req-4a27b3bb-a803-4d2d-adc2-7f1cf2f394ac service nova] Acquired lock "refresh_cache-7260ad81-fc37-4726-8fee-9adecb58040f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.network.neutron [req-245e764f-5448-4ae2-89bf-e6fd5d61f2c8 req-4a27b3bb-a803-4d2d-adc2-7f1cf2f394ac service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Refreshing network info cache for port 706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Start _get_guest_xml network_info=[{"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:23:00 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:23:00 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1028152262',display_name='tempest-ServersNegativeTestJSON-server-1028152262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1028152262',id=35,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80601810103b45acaf3c28a876fb51d8',ramdisk_id='',reservation_id='r-6xzaur15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-405327324',owner_user_name='tempest-ServersNegativeTestJSON-405327324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:22:59Z,user_data=None,user_id='406f12b163cb4a989209213026aae994',uuid=7260ad81-fc37-4726-8fee-9adecb58040f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converting VIF {"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ac:d5,bridge_name='br-int',has_traffic_filtering=True,id=706a5e48-f3b1-445d-b039-930e1ace4068,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706a5e48-f3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.objects.instance [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lazy-loading 'pci_devices' on Instance uuid 7260ad81-fc37-4726-8fee-9adecb58040f {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:23:00 user nova-compute[75205]:   <uuid>7260ad81-fc37-4726-8fee-9adecb58040f</uuid>
Nov 14 19:23:00 user nova-compute[75205]:   <name>instance-00000023</name>
Nov 14 19:23:00 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:23:00 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:23:00 user nova-compute[75205]:   <metadata>
Nov 14 19:23:00 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:23:00 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:23:00 user nova-compute[75205]:       <nova:name>tempest-ServersNegativeTestJSON-server-1028152262</nova:name>
Nov 14 19:23:00 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:23:00</nova:creationTime>
Nov 14 19:23:00 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:23:00 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:23:00 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:23:00 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:23:00 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:23:00 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:23:00 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:23:00 user nova-compute[75205]:       <nova:owner>
Nov 14 19:23:00 user nova-compute[75205]:         <nova:user uuid="406f12b163cb4a989209213026aae994">tempest-ServersNegativeTestJSON-405327324-project-member</nova:user>
Nov 14 19:23:00 user nova-compute[75205]:         <nova:project uuid="80601810103b45acaf3c28a876fb51d8">tempest-ServersNegativeTestJSON-405327324</nova:project>
Nov 14 19:23:00 user nova-compute[75205]:       </nova:owner>
Nov 14 19:23:00 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:23:00 user nova-compute[75205]:       <nova:ports>
Nov 14 19:23:00 user nova-compute[75205]:         <nova:port uuid="706a5e48-f3b1-445d-b039-930e1ace4068">
Nov 14 19:23:00 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 19:23:00 user nova-compute[75205]:         </nova:port>
Nov 14 19:23:00 user nova-compute[75205]:       </nova:ports>
Nov 14 19:23:00 user nova-compute[75205]:     </nova:instance>
Nov 14 19:23:00 user nova-compute[75205]:   </metadata>
Nov 14 19:23:00 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:23:00 user nova-compute[75205]:     <system>
Nov 14 19:23:00 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:23:00 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:23:00 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:23:00 user nova-compute[75205]:       <entry name="serial">7260ad81-fc37-4726-8fee-9adecb58040f</entry>
Nov 14 19:23:00 user nova-compute[75205]:       <entry name="uuid">7260ad81-fc37-4726-8fee-9adecb58040f</entry>
Nov 14 19:23:00 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:23:00 user nova-compute[75205]:     </system>
Nov 14 19:23:00 user nova-compute[75205]:   </sysinfo>
Nov 14 19:23:00 user nova-compute[75205]:   <os>
Nov 14 19:23:00 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:23:00 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:23:00 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:23:00 user nova-compute[75205]:   </os>
Nov 14 19:23:00 user nova-compute[75205]:   <features>
Nov 14 19:23:00 user nova-compute[75205]:     <acpi/>
Nov 14 19:23:00 user nova-compute[75205]:     <apic/>
Nov 14 19:23:00 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:23:00 user nova-compute[75205]:   </features>
Nov 14 19:23:00 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:23:00 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:23:00 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:23:00 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:23:00 user nova-compute[75205]:   </clock>
Nov 14 19:23:00 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:23:00 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:23:00 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:23:00 user nova-compute[75205]:   </cpu>
Nov 14 19:23:00 user nova-compute[75205]:   <devices>
Nov 14 19:23:00 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:23:00 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:23:00 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk"/>
Nov 14 19:23:00 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:23:00 user nova-compute[75205]:     </disk>
Nov 14 19:23:00 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:23:00 user nova-compute[75205]:       <mac address="fa:16:3e:2e:ac:d5"/>
Nov 14 19:23:00 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:23:00 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:23:00 user nova-compute[75205]:       <target dev="tap706a5e48-f3"/>
Nov 14 19:23:00 user nova-compute[75205]:     </interface>
Nov 14 19:23:00 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:23:00 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/console.log" append="off"/>
Nov 14 19:23:00 user nova-compute[75205]:     </serial>
Nov 14 19:23:00 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:23:00 user nova-compute[75205]:     <video>
Nov 14 19:23:00 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:23:00 user nova-compute[75205]:     </video>
Nov 14 19:23:00 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:23:00 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:23:00 user nova-compute[75205]:     </rng>
Nov 14 19:23:00 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:23:00 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:23:00 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:23:00 user nova-compute[75205]:     </memballoon>
Nov 14 19:23:00 user nova-compute[75205]:   </devices>
Nov 14 19:23:00 user nova-compute[75205]: </domain>
Nov 14 19:23:00 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1028152262',display_name='tempest-ServersNegativeTestJSON-server-1028152262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1028152262',id=35,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80601810103b45acaf3c28a876fb51d8',ramdisk_id='',reservation_id='r-6xzaur15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-405327324',owner_user_name='tempest-ServersNegativeTestJSON-405327324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:22:59Z,user_data=None,user_id='406f12b163cb4a989209213026aae994',uuid=7260ad81-fc37-4726-8fee-9adecb58040f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converting VIF {"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ac:d5,bridge_name='br-int',has_traffic_filtering=True,id=706a5e48-f3b1-445d-b039-930e1ace4068,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706a5e48-f3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG os_vif [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ac:d5,bridge_name='br-int',has_traffic_filtering=True,id=706a5e48-f3b1-445d-b039-930e1ace4068,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706a5e48-f3') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d3ea0d6-4937-5486-afdc-128c81382124', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap706a5e48-f3, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap706a5e48-f3, col_values=(('qos', UUID('1f22bfba-a4e8-46d6-9eaf-9ef88411b34f')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap706a5e48-f3, col_values=(('external_ids', {'iface-id': '706a5e48-f3b1-445d-b039-930e1ace4068', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:ac:d5', 'vm-uuid': '7260ad81-fc37-4726-8fee-9adecb58040f'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:00 user nova-compute[75205]: INFO os_vif [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ac:d5,bridge_name='br-int',has_traffic_filtering=True,id=706a5e48-f3b1-445d-b039-930e1ace4068,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706a5e48-f3')
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:23:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] No VIF found with MAC fa:16:3e:2e:ac:d5, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:23:01 user nova-compute[75205]: DEBUG nova.network.neutron [req-245e764f-5448-4ae2-89bf-e6fd5d61f2c8 req-4a27b3bb-a803-4d2d-adc2-7f1cf2f394ac service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Updated VIF entry in instance network info cache for port 706a5e48-f3b1-445d-b039-930e1ace4068. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:23:01 user nova-compute[75205]: DEBUG nova.network.neutron [req-245e764f-5448-4ae2-89bf-e6fd5d61f2c8 req-4a27b3bb-a803-4d2d-adc2-7f1cf2f394ac service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Updating instance_info_cache with network_info: [{"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:23:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-245e764f-5448-4ae2-89bf-e6fd5d61f2c8 req-4a27b3bb-a803-4d2d-adc2-7f1cf2f394ac service nova] Releasing lock "refresh_cache-7260ad81-fc37-4726-8fee-9adecb58040f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-8ce2713f-286b-4d5d-8f39-ef3af1105e26 req-cb06a714-d43a-41b6-ac68-8067db5fbde5 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Received event network-vif-plugged-706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8ce2713f-286b-4d5d-8f39-ef3af1105e26 req-cb06a714-d43a-41b6-ac68-8067db5fbde5 service nova] Acquiring lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8ce2713f-286b-4d5d-8f39-ef3af1105e26 req-cb06a714-d43a-41b6-ac68-8067db5fbde5 service nova] Lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8ce2713f-286b-4d5d-8f39-ef3af1105e26 req-cb06a714-d43a-41b6-ac68-8067db5fbde5 service nova] Lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-8ce2713f-286b-4d5d-8f39-ef3af1105e26 req-cb06a714-d43a-41b6-ac68-8067db5fbde5 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] No waiting events found dispatching network-vif-plugged-706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:02 user nova-compute[75205]: WARNING nova.compute.manager [req-8ce2713f-286b-4d5d-8f39-ef3af1105e26 req-cb06a714-d43a-41b6-ac68-8067db5fbde5 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Received unexpected event network-vif-plugged-706a5e48-f3b1-445d-b039-930e1ace4068 for instance with vm_state building and task_state spawning.
Nov 14 19:23:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:23:04 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Instance spawned successfully.
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-68c61a5b-9961-4fbd-979a-6a52d2d20b42 req-e4068129-d0ad-4558-9b7f-34f75457e5e9 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Received event network-vif-plugged-706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-68c61a5b-9961-4fbd-979a-6a52d2d20b42 req-e4068129-d0ad-4558-9b7f-34f75457e5e9 service nova] Acquiring lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-68c61a5b-9961-4fbd-979a-6a52d2d20b42 req-e4068129-d0ad-4558-9b7f-34f75457e5e9 service nova] Lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-68c61a5b-9961-4fbd-979a-6a52d2d20b42 req-e4068129-d0ad-4558-9b7f-34f75457e5e9 service nova] Lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-68c61a5b-9961-4fbd-979a-6a52d2d20b42 req-e4068129-d0ad-4558-9b7f-34f75457e5e9 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] No waiting events found dispatching network-vif-plugged-706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:04 user nova-compute[75205]: WARNING nova.compute.manager [req-68c61a5b-9961-4fbd-979a-6a52d2d20b42 req-e4068129-d0ad-4558-9b7f-34f75457e5e9 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Received unexpected event network-vif-plugged-706a5e48-f3b1-445d-b039-930e1ace4068 for instance with vm_state building and task_state spawning.
Nov 14 19:23:04 user nova-compute[75205]: INFO nova.compute.manager [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 14 19:23:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:23:04 user nova-compute[75205]: INFO nova.compute.manager [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Took 6.72 seconds to build instance.
Nov 14 19:23:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4365ab45-81c5-410d-a7e8-f380f75eb79d tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "7260ad81-fc37-4726-8fee-9adecb58040f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.819s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-29840475-a138-4543-98b3-82b32a8a0203 req-79e697dc-b8b6-41f4-bd36-380b12f96cce service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-changed-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-29840475-a138-4543-98b3-82b32a8a0203 req-79e697dc-b8b6-41f4-bd36-380b12f96cce service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Refreshing instance network info cache due to event network-changed-9e59c6ca-9156-4128-bcff-efbf329ac5c6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:23:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-29840475-a138-4543-98b3-82b32a8a0203 req-79e697dc-b8b6-41f4-bd36-380b12f96cce service nova] Acquiring lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:23:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-29840475-a138-4543-98b3-82b32a8a0203 req-79e697dc-b8b6-41f4-bd36-380b12f96cce service nova] Acquired lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:23:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-29840475-a138-4543-98b3-82b32a8a0203 req-79e697dc-b8b6-41f4-bd36-380b12f96cce service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Refreshing network info cache for port 9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:23:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-29840475-a138-4543-98b3-82b32a8a0203 req-79e697dc-b8b6-41f4-bd36-380b12f96cce service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updated VIF entry in instance network info cache for port 9e59c6ca-9156-4128-bcff-efbf329ac5c6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:23:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-29840475-a138-4543-98b3-82b32a8a0203 req-79e697dc-b8b6-41f4-bd36-380b12f96cce service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating instance_info_cache with network_info: [{"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:23:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-29840475-a138-4543-98b3-82b32a8a0203 req-79e697dc-b8b6-41f4-bd36-380b12f96cce service nova] Releasing lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "7baa5285-c30b-451c-ab03-ce78ee2c498d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:20 user nova-compute[75205]: INFO nova.compute.manager [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Terminating instance
Nov 14 19:23:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-4b3f3688-60ba-424b-8dde-7c4923b88c35 req-56c8303a-05ba-4dca-bcd6-c267d04315e6 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received event network-vif-unplugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4b3f3688-60ba-424b-8dde-7c4923b88c35 req-56c8303a-05ba-4dca-bcd6-c267d04315e6 service nova] Acquiring lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4b3f3688-60ba-424b-8dde-7c4923b88c35 req-56c8303a-05ba-4dca-bcd6-c267d04315e6 service nova] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4b3f3688-60ba-424b-8dde-7c4923b88c35 req-56c8303a-05ba-4dca-bcd6-c267d04315e6 service nova] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-4b3f3688-60ba-424b-8dde-7c4923b88c35 req-56c8303a-05ba-4dca-bcd6-c267d04315e6 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] No waiting events found dispatching network-vif-unplugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-4b3f3688-60ba-424b-8dde-7c4923b88c35 req-56c8303a-05ba-4dca-bcd6-c267d04315e6 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received event network-vif-unplugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:20 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Instance destroyed successfully.
Nov 14 19:23:20 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'resources' on Instance uuid 7baa5285-c30b-451c-ab03-ce78ee2c498d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-300500849',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-300500849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-300500849',id=34,image_ref='0b9d9b70-ac86-45e4-bea6-38a02294be98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJcGiMcZo+bHKduSwiZaQVSbwZR+BJCRDWiU6cbNeludmMdXRAI+Ydq5NQTyTKjpFpgjJi6F55YCWdVoC3x1jwEBxCT86huw9zzya1ZxF1NS0rGEQ4hYWI2aXZP17GOFw==',key_name='tempest-keypair-1526811545',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:21:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-k10it2v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-397278786',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:21:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=7baa5285-c30b-451c-ab03-ce78ee2c498d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2d:c4,bridge_name='br-int',has_traffic_filtering=True,id=cc8ae615-f2e8-4d45-81ef-ac9237737cd5,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8ae615-f2') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_vif [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2d:c4,bridge_name='br-int',has_traffic_filtering=True,id=cc8ae615-f2e8-4d45-81ef-ac9237737cd5,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8ae615-f2') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc8ae615-f2, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f510bedc-4a38-4bc5-ac52-3597c5140fb0) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:23:20 user nova-compute[75205]: INFO os_vif [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2d:c4,bridge_name='br-int',has_traffic_filtering=True,id=cc8ae615-f2e8-4d45-81ef-ac9237737cd5,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8ae615-f2')
Nov 14 19:23:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYLWKOeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:23:20 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[682a40cd-dbb7-48a4-a812-e22d507fb564]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:23:20 user nova-compute[75205]: No targets found.
Nov 14 19:23:20 user nova-compute[75205]: iSNS:
Nov 14 19:23:20 user nova-compute[75205]: No targets found.
Nov 14 19:23:20 user nova-compute[75205]: STATIC:
Nov 14 19:23:20 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a
Nov 14 19:23:20 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:20 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:20 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:23:20 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:20 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:20 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5
Nov 14 19:23:20 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:20 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:20 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4
Nov 14 19:23:20 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:20 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:20 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d
Nov 14 19:23:20 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:20 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:20 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0
Nov 14 19:23:20 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:20 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:20 user nova-compute[75205]: FIRMWARE:
Nov 14 19:23:20 user nova-compute[75205]: No targets found.
Nov 14 19:23:20 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:23:20 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:23:20 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5b57de-c052-4582-a974-0e1651bee487]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8501eca6-9b5e-4d0d-86d3-c56874c2174e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:23:20 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:23:20 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:23:20 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:23:20 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:23:20 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:23:20 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:23:20 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:23:20 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:23:20 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:23:20 user nova-compute[75205]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 (non-flash)
Nov 14 19:23:20 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:23:20 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb74626050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5'): ({'sde'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Removing single pathed devices sde {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:23:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f13db31-de0a-4d50-963b-15796f698797]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[20508288-b070-4d07-a040-3e85ba4542f0]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flushing IO for device /dev/sde {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[625f8a68-26b6-4aff-8f58-5e83f7fa3254]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f2d7f9-5255-45d8-8876-4d60214303fc]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO94926fd4-5c5c2a41c910f46e', '/dev/disk/by-id/scsi-23563356332613431', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_94926fd4') {{(pid=85714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f031c52-f2d2-4147-b0b8-57eab0ba60e8]: (4, None) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[081ca222-6544-4ed7-8414-062e6fffe763]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ec74f-05ae-47c4-8f77-1d69640e93ec]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5, portal: 172.16.0.220,3260]
Nov 14 19:23:21 user nova-compute[75205]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5, portal: 172.16.0.220,3260] successful.
Nov 14 19:23:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca32c1a0-f648-4268-868c-60484c02cd06]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== disconnect_volume: return (369ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:23:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Deleting instance files /opt/stack/data/nova/instances/7baa5285-c30b-451c-ab03-ce78ee2c498d_del
Nov 14 19:23:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Deletion of /opt/stack/data/nova/instances/7baa5285-c30b-451c-ab03-ce78ee2c498d_del complete
Nov 14 19:23:21 user nova-compute[75205]: INFO nova.compute.manager [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-231d6e9a-82c9-4180-87dc-daea95a2ea35 req-cc26bc4c-4c81-48e3-a839-af74544d11ba service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received event network-changed-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-231d6e9a-82c9-4180-87dc-daea95a2ea35 req-cc26bc4c-4c81-48e3-a839-af74544d11ba service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Refreshing instance network info cache due to event network-changed-cc8ae615-f2e8-4d45-81ef-ac9237737cd5. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-231d6e9a-82c9-4180-87dc-daea95a2ea35 req-cc26bc4c-4c81-48e3-a839-af74544d11ba service nova] Acquiring lock "refresh_cache-7baa5285-c30b-451c-ab03-ce78ee2c498d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-231d6e9a-82c9-4180-87dc-daea95a2ea35 req-cc26bc4c-4c81-48e3-a839-af74544d11ba service nova] Acquired lock "refresh_cache-7baa5285-c30b-451c-ab03-ce78ee2c498d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:23:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-231d6e9a-82c9-4180-87dc-daea95a2ea35 req-cc26bc4c-4c81-48e3-a839-af74544d11ba service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Refreshing network info cache for port cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:23:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-231d6e9a-82c9-4180-87dc-daea95a2ea35 req-cc26bc4c-4c81-48e3-a839-af74544d11ba service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Updated VIF entry in instance network info cache for port cc8ae615-f2e8-4d45-81ef-ac9237737cd5. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:23:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-231d6e9a-82c9-4180-87dc-daea95a2ea35 req-cc26bc4c-4c81-48e3-a839-af74544d11ba service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Updating instance_info_cache with network_info: [{"id": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "address": "fa:16:3e:44:2d:c4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8ae615-f2", "ovs_interfaceid": "cc8ae615-f2e8-4d45-81ef-ac9237737cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:23:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-231d6e9a-82c9-4180-87dc-daea95a2ea35 req-cc26bc4c-4c81-48e3-a839-af74544d11ba service nova] Releasing lock "refresh_cache-7baa5285-c30b-451c-ab03-ce78ee2c498d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:23:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:22 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:23:22 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Took 0.84 seconds to deallocate network for instance.
Nov 14 19:23:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-977e8d16-bf73-4939-9943-6881c1e0998b req-02fddd58-84c4-43b0-91cc-75bf61b41eb8 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received event network-vif-plugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-977e8d16-bf73-4939-9943-6881c1e0998b req-02fddd58-84c4-43b0-91cc-75bf61b41eb8 service nova] Acquiring lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-977e8d16-bf73-4939-9943-6881c1e0998b req-02fddd58-84c4-43b0-91cc-75bf61b41eb8 service nova] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-977e8d16-bf73-4939-9943-6881c1e0998b req-02fddd58-84c4-43b0-91cc-75bf61b41eb8 service nova] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-977e8d16-bf73-4939-9943-6881c1e0998b req-02fddd58-84c4-43b0-91cc-75bf61b41eb8 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] No waiting events found dispatching network-vif-plugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:22 user nova-compute[75205]: WARNING nova.compute.manager [req-977e8d16-bf73-4939-9943-6881c1e0998b req-02fddd58-84c4-43b0-91cc-75bf61b41eb8 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received unexpected event network-vif-plugged-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 for instance with vm_state active and task_state deleting.
Nov 14 19:23:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-977e8d16-bf73-4939-9943-6881c1e0998b req-02fddd58-84c4-43b0-91cc-75bf61b41eb8 service nova] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Received event network-vif-deleted-cc8ae615-f2e8-4d45-81ef-ac9237737cd5 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:22 user nova-compute[75205]: INFO nova.compute.manager [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 19:23:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 7baa5285-c30b-451c-ab03-ce78ee2c498d] Deleting volume: 8ee7cf98-3f3e-4404-ad9c-fc5055f52dd5 {{(pid=75205) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:23 user nova-compute[75205]: INFO nova.compute.manager [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Shelving
Nov 14 19:23:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-867048f9-6d76-49a1-83de-711dc1f572bd req-a005982f-da91-4d6e-8fe9-289cbc66caf7 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-vif-unplugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-867048f9-6d76-49a1-83de-711dc1f572bd req-a005982f-da91-4d6e-8fe9-289cbc66caf7 service nova] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-867048f9-6d76-49a1-83de-711dc1f572bd req-a005982f-da91-4d6e-8fe9-289cbc66caf7 service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-867048f9-6d76-49a1-83de-711dc1f572bd req-a005982f-da91-4d6e-8fe9-289cbc66caf7 service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-867048f9-6d76-49a1-83de-711dc1f572bd req-a005982f-da91-4d6e-8fe9-289cbc66caf7 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] No waiting events found dispatching network-vif-unplugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:23 user nova-compute[75205]: WARNING nova.compute.manager [req-867048f9-6d76-49a1-83de-711dc1f572bd req-a005982f-da91-4d6e-8fe9-289cbc66caf7 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received unexpected event network-vif-unplugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 for instance with vm_state active and task_state shelving.
Nov 14 19:23:23 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:23 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Deleted allocations for instance 7baa5285-c30b-451c-ab03-ce78ee2c498d
Nov 14 19:23:23 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Instance destroyed successfully.
Nov 14 19:23:23 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Beginning cold snapshot process
Nov 14 19:23:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8cd94bf4-a21a-4dc9-b20b-087ace88360f tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "7baa5285-c30b-451c-ab03-ce78ee2c498d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.742s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:23:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk /opt/stack/data/nova/instances/snapshots/tmp4ydpzykb/091b00a83dab4ef7ae1e33f4cb6fdc64 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk /opt/stack/data/nova/instances/snapshots/tmp4ydpzykb/091b00a83dab4ef7ae1e33f4cb6fdc64" returned: 0 in 0.334s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:24 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Snapshot extracted, beginning image upload
Nov 14 19:23:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-201e1ede-e4b7-4bfe-8b89-ec7cbb61822d req-163e8c95-4483-4b5b-9ab4-796bf5640f33 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-201e1ede-e4b7-4bfe-8b89-ec7cbb61822d req-163e8c95-4483-4b5b-9ab4-796bf5640f33 service nova] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-201e1ede-e4b7-4bfe-8b89-ec7cbb61822d req-163e8c95-4483-4b5b-9ab4-796bf5640f33 service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-201e1ede-e4b7-4bfe-8b89-ec7cbb61822d req-163e8c95-4483-4b5b-9ab4-796bf5640f33 service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-201e1ede-e4b7-4bfe-8b89-ec7cbb61822d req-163e8c95-4483-4b5b-9ab4-796bf5640f33 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] No waiting events found dispatching network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:25 user nova-compute[75205]: WARNING nova.compute.manager [req-201e1ede-e4b7-4bfe-8b89-ec7cbb61822d req-163e8c95-4483-4b5b-9ab4-796bf5640f33 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received unexpected event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 19:23:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:27 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Snapshot image upload complete
Nov 14 19:23:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:23:27 user nova-compute[75205]: INFO nova.compute.manager [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Shelve offloading
Nov 14 19:23:27 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Instance destroyed successfully.
Nov 14 19:23:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:23:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:23:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquired lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:23:27 user nova-compute[75205]: DEBUG nova.network.neutron [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:23:27 user nova-compute[75205]: DEBUG nova.network.neutron [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating instance_info_cache with network_info: [{"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:23:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Releasing lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:23:28 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Instance destroyed successfully.
Nov 14 19:23:28 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'resources' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1591317232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1591317232',id=33,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY8BN4OSjDQM9rqpkJC6Z7KTJgav9yS3Me+QYcBpJkEthzcRB7SVixd0ikK9C5zzMHVLxnztcwbe3psghv24kPmGsvMk6DW7JWIN5RcYEAx2G7/gaedbeU38l6UAtrTqg==',key_name='tempest-keypair-1469195162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-sjq8e8cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member',shelved_at='2023-11-14T19:23:27.406448',shelved_host='user',shelved_image_id='59e9a68d-0109-4fa0-83ac-8fd83c5539c0'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:23:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=6e5b652c-e7bf-4b77-bb84-db5c399cb538,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG os_vif [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e59c6ca-91, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG nova.compute.manager [req-96a403de-b396-428d-a878-52c3163df38c req-0734bbc9-36a3-4f64-94bd-9ab67fa59a49 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-changed-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG nova.compute.manager [req-96a403de-b396-428d-a878-52c3163df38c req-0734bbc9-36a3-4f64-94bd-9ab67fa59a49 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Refreshing instance network info cache due to event network-changed-9e59c6ca-9156-4128-bcff-efbf329ac5c6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-96a403de-b396-428d-a878-52c3163df38c req-0734bbc9-36a3-4f64-94bd-9ab67fa59a49 service nova] Acquiring lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-96a403de-b396-428d-a878-52c3163df38c req-0734bbc9-36a3-4f64-94bd-9ab67fa59a49 service nova] Acquired lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG nova.network.neutron [req-96a403de-b396-428d-a878-52c3163df38c req-0734bbc9-36a3-4f64-94bd-9ab67fa59a49 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Refreshing network info cache for port 9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8df8dfe9-fe2f-4081-873e-8bf7e5ab671b) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:23:28 user nova-compute[75205]: INFO os_vif [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91')
Nov 14 19:23:28 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Deleting instance files /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538_del
Nov 14 19:23:28 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Deletion of /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538_del complete
Nov 14 19:23:28 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Deleted allocations for instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538
Nov 14 19:23:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'numa_topology' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:23:28 user nova-compute[75205]: DEBUG nova.objects.base [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Object Instance<6e5b652c-e7bf-4b77-bb84-db5c399cb538> lazy-loaded attributes: resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:23:29 user nova-compute[75205]: DEBUG nova.network.neutron [req-96a403de-b396-428d-a878-52c3163df38c req-0734bbc9-36a3-4f64-94bd-9ab67fa59a49 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updated VIF entry in instance network info cache for port 9e59c6ca-9156-4128-bcff-efbf329ac5c6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:23:29 user nova-compute[75205]: DEBUG nova.network.neutron [req-96a403de-b396-428d-a878-52c3163df38c req-0734bbc9-36a3-4f64-94bd-9ab67fa59a49 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating instance_info_cache with network_info: [{"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:23:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-96a403de-b396-428d-a878-52c3163df38c req-0734bbc9-36a3-4f64-94bd-9ab67fa59a49 service nova] Releasing lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:23:29 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:23:29 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:23:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0a3b22f1-090c-4f57-bb6b-e84e17e9e034 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.252s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:30 user nova-compute[75205]: INFO nova.compute.manager [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Detaching volume 0eff452a-8d32-4e11-90df-fc8a9b25a11a
Nov 14 19:23:30 user nova-compute[75205]: INFO nova.virt.block_device [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Attempting to driver detach volume 0eff452a-8d32-4e11-90df-fc8a9b25a11a from mountpoint /dev/vdb
Nov 14 19:23:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Attempting to detach device vdb from instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:23:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:23:30 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:23:30 user nova-compute[75205]:   <source dev="/dev/sdf"/>
Nov 14 19:23:30 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:23:30 user nova-compute[75205]:   <serial>0eff452a-8d32-4e11-90df-fc8a9b25a11a</serial>
Nov 14 19:23:30 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 19:23:30 user nova-compute[75205]: </disk>
Nov 14 19:23:30 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:23:30 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully detached device vdb from instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 from the persistent domain config.
Nov 14 19:23:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:23:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:23:30 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:23:30 user nova-compute[75205]:   <source dev="/dev/sdf"/>
Nov 14 19:23:30 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:23:30 user nova-compute[75205]:   <serial>0eff452a-8d32-4e11-90df-fc8a9b25a11a</serial>
Nov 14 19:23:30 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 19:23:30 user nova-compute[75205]: </disk>
Nov 14 19:23:30 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:23:31 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:23:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:23:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:23:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:23:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:23:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:32 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:23:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:34 user nova-compute[75205]: INFO nova.compute.manager [None req-2944a980-1686-49a6-be4a-fd327adfa0a8 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Unrescuing
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2944a980-1686-49a6-be4a-fd327adfa0a8 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2944a980-1686-49a6-be4a-fd327adfa0a8 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquired lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG nova.network.neutron [None req-2944a980-1686-49a6-be4a-fd327adfa0a8 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG nova.network.neutron [None req-2944a980-1686-49a6-be4a-fd327adfa0a8 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Updating instance_info_cache with network_info: [{"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2944a980-1686-49a6-be4a-fd327adfa0a8 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Releasing lock "refresh_cache-1ec04cbd-a532-4e15-ba88-a87e6d41e249" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG nova.objects.instance [None req-2944a980-1686-49a6-be4a-fd327adfa0a8 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'flavor' on Instance uuid 1ec04cbd-a532-4e15-ba88-a87e6d41e249 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-8b81247e-8f08-4be8-b2c5-bd1ab8142016 req-27d3c134-d1db-4fd0-bae3-944028588d15 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8b81247e-8f08-4be8-b2c5-bd1ab8142016 req-27d3c134-d1db-4fd0-bae3-944028588d15 service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8b81247e-8f08-4be8-b2c5-bd1ab8142016 req-27d3c134-d1db-4fd0-bae3-944028588d15 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8b81247e-8f08-4be8-b2c5-bd1ab8142016 req-27d3c134-d1db-4fd0-bae3-944028588d15 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-8b81247e-8f08-4be8-b2c5-bd1ab8142016 req-27d3c134-d1db-4fd0-bae3-944028588d15 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:35 user nova-compute[75205]: WARNING nova.compute.manager [req-8b81247e-8f08-4be8-b2c5-bd1ab8142016 req-27d3c134-d1db-4fd0-bae3-944028588d15 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:23:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:23:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:36 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Instance destroyed successfully.
Nov 14 19:23:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:39 user nova-compute[75205]: WARNING nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:39 user nova-compute[75205]: WARNING nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:39 user nova-compute[75205]: WARNING nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:39 user nova-compute[75205]: WARNING nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:39 user nova-compute[75205]: WARNING nova.compute.manager [req-23b507fa-1d12-4987-975a-7354f9dc0fc1 req-37da6ddf-7a8a-4681-876b-65f4a38bf1eb service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:39 user nova-compute[75205]: WARNING nova.compute.manager [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:23:39 user nova-compute[75205]: WARNING nova.compute.manager [req-9cec7067-4af0-478e-b2f4-57d14d236a65 req-f6dca798-926a-4ff2-9802-5a6de14c905f service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-2944a980-1686-49a6-be4a-fd327adfa0a8 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:23:39 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:23:39 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=24.89739227294922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2a32bb26-deb4-407d-a9e9-31de887e0b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d1a77658-d712-402d-b67b-322751e2f202 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1ec04cbd-a532-4e15-ba88-a87e6d41e249 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7260ad81-fc37-4726-8fee-9adecb58040f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:23:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:23:40 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:23:40 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:23:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:23:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6e3657fa-d795-4732-852a-158c68452387] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 6e3657fa-d795-4732-852a-158c68452387 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updating instance_info_cache with network_info: [{"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-6e3657fa-d795-4732-852a-158c68452387" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:23:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:23:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:23:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 is timed out.
Nov 14 19:23:51 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully detached device vdb from instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99 from the live domain config.
Nov 14 19:23:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhcCeLWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:23:51 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[637d3b87-e318-4127-be09-d6d460359a7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:23:51 user nova-compute[75205]: No targets found.
Nov 14 19:23:51 user nova-compute[75205]: iSNS:
Nov 14 19:23:51 user nova-compute[75205]: No targets found.
Nov 14 19:23:51 user nova-compute[75205]: STATIC:
Nov 14 19:23:51 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a
Nov 14 19:23:51 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:51 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:51 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:23:51 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:51 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:51 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4
Nov 14 19:23:51 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:51 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:51 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d
Nov 14 19:23:51 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:51 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:51 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0
Nov 14 19:23:51 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:23:51 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:23:51 user nova-compute[75205]: FIRMWARE:
Nov 14 19:23:51 user nova-compute[75205]: No targets found.
Nov 14 19:23:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:23:51 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:23:51 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e78b01c-66f1-48d3-8832-333a7e9029f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9379b5-c5ee-4ed0-9cca-1e79c8faede1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:23:51 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:23:51 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:23:51 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:23:51 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:23:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:23:51 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:23:51 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:23:51 user nova-compute[75205]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a (non-flash)
Nov 14 19:23:51 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:23:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb74176560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a'): ({'sdf'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Removing single pathed devices sdf {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7484e862-e971-4518-b501-9a354c56a5a5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab48d01-8c99-4f74-8238-1b82f767817a]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flushing IO for device /dev/sdf {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfc3dd4-e063-49b3-8708-da6d708c8386]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b15a2-eabe-4729-b8f7-79d326dbaf26]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] SCSI volumes sdf have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[13161515-96d2-4f25-bb8e-6bc30329b0b8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b22c5a-e3b7-49fe-83a5-c5d88efce8d7]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260]
Nov 14 19:23:51 user nova-compute[75205]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a, portal: 172.16.0.220,3260] successful.
Nov 14 19:23:51 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eff452a-8d32-4e11-90df-fc8a9b25a11a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[292c1691-182e-4d72-a77e-8c31a723d181]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== disconnect_volume: return (315ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:23:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:23:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:52 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'flavor' on Instance uuid 76a6c07f-15b9-4640-bc5a-8f288c7aba99 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:23:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f1a8f5e6-53a3-4f3e-b773-9b630a2e1431 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.664s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:23:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:23:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "d1a77658-d712-402d-b67b-322751e2f202" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d1a77658-d712-402d-b67b-322751e2f202" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "d1a77658-d712-402d-b67b-322751e2f202-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d1a77658-d712-402d-b67b-322751e2f202-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d1a77658-d712-402d-b67b-322751e2f202-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:11 user nova-compute[75205]: INFO nova.compute.manager [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Terminating instance
Nov 14 19:24:11 user nova-compute[75205]: DEBUG nova.compute.manager [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:24:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-b4fe6a44-2da2-435b-9133-706fdd575158 req-57c9bd96-d5fc-4736-bdc0-af1d16feaad0 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received event network-vif-unplugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b4fe6a44-2da2-435b-9133-706fdd575158 req-57c9bd96-d5fc-4736-bdc0-af1d16feaad0 service nova] Acquiring lock "d1a77658-d712-402d-b67b-322751e2f202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b4fe6a44-2da2-435b-9133-706fdd575158 req-57c9bd96-d5fc-4736-bdc0-af1d16feaad0 service nova] Lock "d1a77658-d712-402d-b67b-322751e2f202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b4fe6a44-2da2-435b-9133-706fdd575158 req-57c9bd96-d5fc-4736-bdc0-af1d16feaad0 service nova] Lock "d1a77658-d712-402d-b67b-322751e2f202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-b4fe6a44-2da2-435b-9133-706fdd575158 req-57c9bd96-d5fc-4736-bdc0-af1d16feaad0 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] No waiting events found dispatching network-vif-unplugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-b4fe6a44-2da2-435b-9133-706fdd575158 req-57c9bd96-d5fc-4736-bdc0-af1d16feaad0 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received event network-vif-unplugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d1a77658-d712-402d-b67b-322751e2f202] Instance destroyed successfully.
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.objects.instance [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'resources' on Instance uuid d1a77658-d712-402d-b67b-322751e2f202 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:19:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1821458419',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1821458419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1821458419',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGFWw0BmGhBPPz35ZLdiBa1JKOX310idLb8FbKN+OmSGJoG8ylMI0J6aR8LEEzvuQGi37s+Bb6dOUWK8NklcEubwpRB16+bfPZNITKNnhqho9m0eU13uZ4YikE+WXJMqQ==',key_name='tempest-keypair-441669733',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:20:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-97hax086',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=d1a77658-d712-402d-b67b-322751e2f202,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "address": "fa:16:3e:ce:be:43", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05de1606-06", "ovs_interfaceid": "05de1606-06bb-42c1-89f0-0e6d3bdb7812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:be:43,bridge_name='br-int',has_traffic_filtering=True,id=05de1606-06bb-42c1-89f0-0e6d3bdb7812,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05de1606-06') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_vif [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:be:43,bridge_name='br-int',has_traffic_filtering=True,id=05de1606-06bb-42c1-89f0-0e6d3bdb7812,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05de1606-06') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05de1606-06, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=002b762a-c171-45c4-a2d2-ed639f4b820b) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:12 user nova-compute[75205]: INFO os_vif [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:be:43,bridge_name='br-int',has_traffic_filtering=True,id=05de1606-06bb-42c1-89f0-0e6d3bdb7812,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05de1606-06')
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIOvhEeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:24:12 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a1e843-ccc1-4762-85b1-06e94b92048c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:24:12 user nova-compute[75205]: No targets found.
Nov 14 19:24:12 user nova-compute[75205]: iSNS:
Nov 14 19:24:12 user nova-compute[75205]: No targets found.
Nov 14 19:24:12 user nova-compute[75205]: STATIC:
Nov 14 19:24:12 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:24:12 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:24:12 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:24:12 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4
Nov 14 19:24:12 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:24:12 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:24:12 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d
Nov 14 19:24:12 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:24:12 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:24:12 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0
Nov 14 19:24:12 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:24:12 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:24:12 user nova-compute[75205]: FIRMWARE:
Nov 14 19:24:12 user nova-compute[75205]: No targets found.
Nov 14 19:24:12 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:24:12 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:24:12 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5779ed-1e2a-4fd1-b90e-9494163ec727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5163ea3b-8589-4ff8-911a-eb0c002b8d6d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:24:12 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:24:12 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:24:12 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:24:12 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:24:12 user nova-compute[75205]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d (non-flash)
Nov 14 19:24:12 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:24:12 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:24:12 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb742dc550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7387f6a6-b64a-4246-8e99-57340df5f1eb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[728fb01a-4271-4aea-8f59-68ae46ab4630]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be1d4ff-0d83-4db8-b641-b37221428e9d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb8a057-ef00-4c46-b381-0fdb4071083b]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[82111ae5-4087-4d57-9338-0b90ed6f987f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[652c84ab-dd5a-453d-a582-f74e6d83b749]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d, portal: 172.16.0.220,3260]
Nov 14 19:24:12 user nova-compute[75205]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d, portal: 172.16.0.220,3260] successful.
Nov 14 19:24:12 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5087c09-42c8-40e4-9a60-d499d9cb706d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff13896c-489c-44c9-9751-9898bc48f4f7]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== disconnect_volume: return (322ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:24:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Deleting instance files /opt/stack/data/nova/instances/d1a77658-d712-402d-b67b-322751e2f202_del
Nov 14 19:24:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Deletion of /opt/stack/data/nova/instances/d1a77658-d712-402d-b67b-322751e2f202_del complete
Nov 14 19:24:12 user nova-compute[75205]: INFO nova.compute.manager [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 19:24:12 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: d1a77658-d712-402d-b67b-322751e2f202] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:24:12 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: d1a77658-d712-402d-b67b-322751e2f202] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:24:13 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: d1a77658-d712-402d-b67b-322751e2f202] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:24:13 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: d1a77658-d712-402d-b67b-322751e2f202] Took 0.80 seconds to deallocate network for instance.
Nov 14 19:24:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-a0c2cf0d-7088-44de-8d58-694e32c012d8 req-bb9d1029-fbeb-4d32-9cf5-73044b3589e4 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received event network-vif-plugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a0c2cf0d-7088-44de-8d58-694e32c012d8 req-bb9d1029-fbeb-4d32-9cf5-73044b3589e4 service nova] Acquiring lock "d1a77658-d712-402d-b67b-322751e2f202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a0c2cf0d-7088-44de-8d58-694e32c012d8 req-bb9d1029-fbeb-4d32-9cf5-73044b3589e4 service nova] Lock "d1a77658-d712-402d-b67b-322751e2f202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a0c2cf0d-7088-44de-8d58-694e32c012d8 req-bb9d1029-fbeb-4d32-9cf5-73044b3589e4 service nova] Lock "d1a77658-d712-402d-b67b-322751e2f202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-a0c2cf0d-7088-44de-8d58-694e32c012d8 req-bb9d1029-fbeb-4d32-9cf5-73044b3589e4 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] No waiting events found dispatching network-vif-plugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:24:14 user nova-compute[75205]: WARNING nova.compute.manager [req-a0c2cf0d-7088-44de-8d58-694e32c012d8 req-bb9d1029-fbeb-4d32-9cf5-73044b3589e4 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received unexpected event network-vif-plugged-05de1606-06bb-42c1-89f0-0e6d3bdb7812 for instance with vm_state active and task_state deleting.
Nov 14 19:24:14 user nova-compute[75205]: DEBUG nova.compute.manager [req-a0c2cf0d-7088-44de-8d58-694e32c012d8 req-bb9d1029-fbeb-4d32-9cf5-73044b3589e4 service nova] [instance: d1a77658-d712-402d-b67b-322751e2f202] Received event network-vif-deleted-05de1606-06bb-42c1-89f0-0e6d3bdb7812 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:14 user nova-compute[75205]: INFO nova.compute.manager [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 19:24:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: d1a77658-d712-402d-b67b-322751e2f202] Deleting volume: a5087c09-42c8-40e4-9a60-d499d9cb706d {{(pid=75205) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 19:24:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:14 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:24:14 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:24:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:14 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Deleted allocations for instance d1a77658-d712-402d-b67b-322751e2f202
Nov 14 19:24:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-66092fa5-acad-4f6e-a4dc-659d2c85c83b tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "d1a77658-d712-402d-b67b-322751e2f202" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.257s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:21 user nova-compute[75205]: INFO nova.compute.manager [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Terminating instance
Nov 14 19:24:21 user nova-compute[75205]: DEBUG nova.compute.manager [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-64c0533a-6aa9-438e-a0a1-fb2044e2af57 req-4581362f-5904-4f45-881c-79d0f3e07a00 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-vif-unplugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-64c0533a-6aa9-438e-a0a1-fb2044e2af57 req-4581362f-5904-4f45-881c-79d0f3e07a00 service nova] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-64c0533a-6aa9-438e-a0a1-fb2044e2af57 req-4581362f-5904-4f45-881c-79d0f3e07a00 service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-64c0533a-6aa9-438e-a0a1-fb2044e2af57 req-4581362f-5904-4f45-881c-79d0f3e07a00 service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-64c0533a-6aa9-438e-a0a1-fb2044e2af57 req-4581362f-5904-4f45-881c-79d0f3e07a00 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] No waiting events found dispatching network-vif-unplugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-64c0533a-6aa9-438e-a0a1-fb2044e2af57 req-4581362f-5904-4f45-881c-79d0f3e07a00 service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-vif-unplugged-7989cadb-ee49-4c2e-836f-655dc71f5576 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Instance destroyed successfully.
Nov 14 19:24:21 user nova-compute[75205]: DEBUG nova.objects.instance [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'resources' on Instance uuid 76a6c07f-15b9-4640-bc5a-8f288c7aba99 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-54069087',display_name='tempest-ServerActionsTestOtherA-server-925782016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-54069087',id=28,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmFMu1MhmNNODqxye2oYQgfRj0rdLs44i/hgnq8MB347rg/uZ2vJKnDG8bTLCgPOHpMZNKcMILt0sMLy2yvyzP3vcTosOElc4xxRalFM4BT+P3pJ71xkhxpnimPcAPydA==',key_name='tempest-keypair-137945461',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-yx5vb0xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=76a6c07f-15b9-4640-bc5a-8f288c7aba99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "7989cadb-ee49-4c2e-836f-655dc71f5576", "address": "fa:16:3e:3d:74:7e", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7989cadb-ee", "ovs_interfaceid": "7989cadb-ee49-4c2e-836f-655dc71f5576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG os_vif [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7989cadb-ee, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b17e54ac-f446-41c9-8a88-a3a7dbe906c4) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:21 user nova-compute[75205]: INFO os_vif [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:74:7e,bridge_name='br-int',has_traffic_filtering=True,id=7989cadb-ee49-4c2e-836f-655dc71f5576,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7989cadb-ee')
Nov 14 19:24:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Deleting instance files /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99_del
Nov 14 19:24:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Deletion of /opt/stack/data/nova/instances/76a6c07f-15b9-4640-bc5a-8f288c7aba99_del complete
Nov 14 19:24:21 user nova-compute[75205]: INFO nova.compute.manager [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 14 19:24:21 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:24:21 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:24:22 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:24:23 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Took 1.03 seconds to deallocate network for instance.
Nov 14 19:24:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:23 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:24:23 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:24:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-35c1dbee-d70e-4b14-bf9f-5927f2274591 req-4aafc7f9-d6ae-4997-8c2e-465c5b8a4efc service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35c1dbee-d70e-4b14-bf9f-5927f2274591 req-4aafc7f9-d6ae-4997-8c2e-465c5b8a4efc service nova] Acquiring lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35c1dbee-d70e-4b14-bf9f-5927f2274591 req-4aafc7f9-d6ae-4997-8c2e-465c5b8a4efc service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-35c1dbee-d70e-4b14-bf9f-5927f2274591 req-4aafc7f9-d6ae-4997-8c2e-465c5b8a4efc service nova] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-35c1dbee-d70e-4b14-bf9f-5927f2274591 req-4aafc7f9-d6ae-4997-8c2e-465c5b8a4efc service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] No waiting events found dispatching network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:24:23 user nova-compute[75205]: WARNING nova.compute.manager [req-35c1dbee-d70e-4b14-bf9f-5927f2274591 req-4aafc7f9-d6ae-4997-8c2e-465c5b8a4efc service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received unexpected event network-vif-plugged-7989cadb-ee49-4c2e-836f-655dc71f5576 for instance with vm_state deleted and task_state None.
Nov 14 19:24:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-35c1dbee-d70e-4b14-bf9f-5927f2274591 req-4aafc7f9-d6ae-4997-8c2e-465c5b8a4efc service nova] [instance: 76a6c07f-15b9-4640-bc5a-8f288c7aba99] Received event network-vif-deleted-7989cadb-ee49-4c2e-836f-655dc71f5576 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:23 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Deleted allocations for instance 76a6c07f-15b9-4640-bc5a-8f288c7aba99
Nov 14 19:24:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6f1ed893-e848-4660-85c9-364b60126a00 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "76a6c07f-15b9-4640-bc5a-8f288c7aba99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.393s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:31 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:24:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:24:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:33 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:33 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:24:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:24:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:37 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:24:37 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7856MB free_disk=24.924453735351562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2a32bb26-deb4-407d-a9e9-31de887e0b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1ec04cbd-a532-4e15-ba88-a87e6d41e249 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7260ad81-fc37-4726-8fee-9adecb58040f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:24:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updating instance_info_cache with network_info: [{"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-d453ca1b-600f-40a9-9478-60ae619302ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 19:24:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] There are 0 instances to clean {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 19:24:40 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75205) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 19:24:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 6e3657fa-d795-4732-852a-158c68452387 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 7803fcca-eed8-4088-b1dc-e0908dcecaa4 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 934d0407-7d12-4edb-99d2-8558be6427d6 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 2a32bb26-deb4-407d-a9e9-31de887e0b38 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 1ec04cbd-a532-4e15-ba88-a87e6d41e249 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 7260ad81-fc37-4726-8fee-9adecb58040f {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "6e3657fa-d795-4732-852a-158c68452387" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "6e3657fa-d795-4732-852a-158c68452387" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "d453ca1b-600f-40a9-9478-60ae619302ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "934d0407-7d12-4edb-99d2-8558be6427d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "934d0407-7d12-4edb-99d2-8558be6427d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "2a32bb26-deb4-407d-a9e9-31de887e0b38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "7260ad81-fc37-4726-8fee-9adecb58040f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "7260ad81-fc37-4726-8fee-9adecb58040f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "6e3657fa-d795-4732-852a-158c68452387" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "d453ca1b-600f-40a9-9478-60ae619302ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "934d0407-7d12-4edb-99d2-8558be6427d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "7260ad81-fc37-4726-8fee-9adecb58040f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:42 user nova-compute[75205]: INFO nova.compute.manager [None req-074ce4a6-3da9-4124-aa1b-3e6db8193c72 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Unrescuing
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-074ce4a6-3da9-4124-aa1b-3e6db8193c72 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-074ce4a6-3da9-4124-aa1b-3e6db8193c72 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquired lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:24:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-074ce4a6-3da9-4124-aa1b-3e6db8193c72 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG nova.network.neutron [None req-074ce4a6-3da9-4124-aa1b-3e6db8193c72 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updating instance_info_cache with network_info: [{"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-074ce4a6-3da9-4124-aa1b-3e6db8193c72 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Releasing lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG nova.objects.instance [None req-074ce4a6-3da9-4124-aa1b-3e6db8193c72 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'flavor' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-09023a0d-d816-44bd-bef7-2d488367c658 req-8bc6cf13-42b2-463b-88d3-c229ad1e9a38 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-unplugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-09023a0d-d816-44bd-bef7-2d488367c658 req-8bc6cf13-42b2-463b-88d3-c229ad1e9a38 service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-09023a0d-d816-44bd-bef7-2d488367c658 req-8bc6cf13-42b2-463b-88d3-c229ad1e9a38 service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-09023a0d-d816-44bd-bef7-2d488367c658 req-8bc6cf13-42b2-463b-88d3-c229ad1e9a38 service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-09023a0d-d816-44bd-bef7-2d488367c658 req-8bc6cf13-42b2-463b-88d3-c229ad1e9a38 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-unplugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:24:43 user nova-compute[75205]: WARNING nova.compute.manager [req-09023a0d-d816-44bd-bef7-2d488367c658 req-8bc6cf13-42b2-463b-88d3-c229ad1e9a38 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-unplugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:24:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:43 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Instance destroyed successfully.
Nov 14 19:24:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:24:45 user nova-compute[75205]: WARNING nova.compute.manager [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:24:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:24:45 user nova-compute[75205]: WARNING nova.compute.manager [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:24:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:24:45 user nova-compute[75205]: WARNING nova.compute.manager [req-eb1b16a8-b3b0-4043-a5b2-4420d2a31822 req-f3e363f0-a6e1-4899-95c8-b4235f13c88b service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state rescued and task_state unrescuing.
Nov 14 19:24:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-074ce4a6-3da9-4124-aa1b-3e6db8193c72 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:24:49 user nova-compute[75205]: INFO nova.compute.claims [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Claim successful on node user
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.network.neutron [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:24:49 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.policy [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '406f12b163cb4a989209213026aae994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80601810103b45acaf3c28a876fb51d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:24:49 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Creating image(s)
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "/opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "/opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "/opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.191s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk 1073741824" returned: 0 in 0.064s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Successfully created port: 80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Cannot resize image /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Ensure instance console log exists: /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Successfully updated port: 80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "refresh_cache-e59c991e-1921-4e71-8680-b8ceb4f3ccf2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquired lock "refresh_cache-e59c991e-1921-4e71-8680-b8ceb4f3ccf2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG nova.compute.manager [req-403812c5-84f6-4d04-9a9a-19111590e9d3 req-2c4d749e-1635-4e37-ab14-973fa4c11945 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Received event network-changed-80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG nova.compute.manager [req-403812c5-84f6-4d04-9a9a-19111590e9d3 req-2c4d749e-1635-4e37-ab14-973fa4c11945 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Refreshing instance network info cache due to event network-changed-80a242ef-40ae-4609-b6bb-dc5c169c7f0c. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-403812c5-84f6-4d04-9a9a-19111590e9d3 req-2c4d749e-1635-4e37-ab14-973fa4c11945 service nova] Acquiring lock "refresh_cache-e59c991e-1921-4e71-8680-b8ceb4f3ccf2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:24:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Updating instance_info_cache with network_info: [{"id": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "address": "fa:16:3e:69:c6:51", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a242ef-40", "ovs_interfaceid": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Releasing lock "refresh_cache-e59c991e-1921-4e71-8680-b8ceb4f3ccf2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Instance network_info: |[{"id": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "address": "fa:16:3e:69:c6:51", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a242ef-40", "ovs_interfaceid": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-403812c5-84f6-4d04-9a9a-19111590e9d3 req-2c4d749e-1635-4e37-ab14-973fa4c11945 service nova] Acquired lock "refresh_cache-e59c991e-1921-4e71-8680-b8ceb4f3ccf2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.network.neutron [req-403812c5-84f6-4d04-9a9a-19111590e9d3 req-2c4d749e-1635-4e37-ab14-973fa4c11945 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Refreshing network info cache for port 80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Start _get_guest_xml network_info=[{"id": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "address": "fa:16:3e:69:c6:51", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a242ef-40", "ovs_interfaceid": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:24:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:24:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1665402174',display_name='tempest-ServersNegativeTestJSON-server-1665402174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1665402174',id=36,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80601810103b45acaf3c28a876fb51d8',ramdisk_id='',reservation_id='r-asrbfx0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-405327324',owner_user_name='tempest-ServersNegativeTestJSON-405327324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:24:50Z,user_data=None,user_id='406f12b163cb4a989209213026aae994',uuid=e59c991e-1921-4e71-8680-b8ceb4f3ccf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "address": "fa:16:3e:69:c6:51", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a242ef-40", "ovs_interfaceid": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converting VIF {"id": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "address": "fa:16:3e:69:c6:51", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a242ef-40", "ovs_interfaceid": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c6:51,bridge_name='br-int',has_traffic_filtering=True,id=80a242ef-40ae-4609-b6bb-dc5c169c7f0c,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a242ef-40') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.objects.instance [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lazy-loading 'pci_devices' on Instance uuid e59c991e-1921-4e71-8680-b8ceb4f3ccf2 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:24:51 user nova-compute[75205]:   <uuid>e59c991e-1921-4e71-8680-b8ceb4f3ccf2</uuid>
Nov 14 19:24:51 user nova-compute[75205]:   <name>instance-00000024</name>
Nov 14 19:24:51 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:24:51 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:24:51 user nova-compute[75205]:   <metadata>
Nov 14 19:24:51 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:24:51 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:24:51 user nova-compute[75205]:       <nova:name>tempest-ServersNegativeTestJSON-server-1665402174</nova:name>
Nov 14 19:24:51 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:24:51</nova:creationTime>
Nov 14 19:24:51 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:24:51 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:24:51 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:24:51 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:24:51 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:24:51 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:24:51 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:24:51 user nova-compute[75205]:       <nova:owner>
Nov 14 19:24:51 user nova-compute[75205]:         <nova:user uuid="406f12b163cb4a989209213026aae994">tempest-ServersNegativeTestJSON-405327324-project-member</nova:user>
Nov 14 19:24:51 user nova-compute[75205]:         <nova:project uuid="80601810103b45acaf3c28a876fb51d8">tempest-ServersNegativeTestJSON-405327324</nova:project>
Nov 14 19:24:51 user nova-compute[75205]:       </nova:owner>
Nov 14 19:24:51 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:24:51 user nova-compute[75205]:       <nova:ports>
Nov 14 19:24:51 user nova-compute[75205]:         <nova:port uuid="80a242ef-40ae-4609-b6bb-dc5c169c7f0c">
Nov 14 19:24:51 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 19:24:51 user nova-compute[75205]:         </nova:port>
Nov 14 19:24:51 user nova-compute[75205]:       </nova:ports>
Nov 14 19:24:51 user nova-compute[75205]:     </nova:instance>
Nov 14 19:24:51 user nova-compute[75205]:   </metadata>
Nov 14 19:24:51 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:24:51 user nova-compute[75205]:     <system>
Nov 14 19:24:51 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:24:51 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:24:51 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:24:51 user nova-compute[75205]:       <entry name="serial">e59c991e-1921-4e71-8680-b8ceb4f3ccf2</entry>
Nov 14 19:24:51 user nova-compute[75205]:       <entry name="uuid">e59c991e-1921-4e71-8680-b8ceb4f3ccf2</entry>
Nov 14 19:24:51 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:24:51 user nova-compute[75205]:     </system>
Nov 14 19:24:51 user nova-compute[75205]:   </sysinfo>
Nov 14 19:24:51 user nova-compute[75205]:   <os>
Nov 14 19:24:51 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:24:51 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:24:51 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:24:51 user nova-compute[75205]:   </os>
Nov 14 19:24:51 user nova-compute[75205]:   <features>
Nov 14 19:24:51 user nova-compute[75205]:     <acpi/>
Nov 14 19:24:51 user nova-compute[75205]:     <apic/>
Nov 14 19:24:51 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:24:51 user nova-compute[75205]:   </features>
Nov 14 19:24:51 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:24:51 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:24:51 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:24:51 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:24:51 user nova-compute[75205]:   </clock>
Nov 14 19:24:51 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:24:51 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:24:51 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:24:51 user nova-compute[75205]:   </cpu>
Nov 14 19:24:51 user nova-compute[75205]:   <devices>
Nov 14 19:24:51 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:24:51 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:24:51 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk"/>
Nov 14 19:24:51 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:24:51 user nova-compute[75205]:     </disk>
Nov 14 19:24:51 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:24:51 user nova-compute[75205]:       <mac address="fa:16:3e:69:c6:51"/>
Nov 14 19:24:51 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:24:51 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:24:51 user nova-compute[75205]:       <target dev="tap80a242ef-40"/>
Nov 14 19:24:51 user nova-compute[75205]:     </interface>
Nov 14 19:24:51 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:24:51 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/console.log" append="off"/>
Nov 14 19:24:51 user nova-compute[75205]:     </serial>
Nov 14 19:24:51 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:24:51 user nova-compute[75205]:     <video>
Nov 14 19:24:51 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:24:51 user nova-compute[75205]:     </video>
Nov 14 19:24:51 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:24:51 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:24:51 user nova-compute[75205]:     </rng>
Nov 14 19:24:51 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:24:51 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:24:51 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:24:51 user nova-compute[75205]:     </memballoon>
Nov 14 19:24:51 user nova-compute[75205]:   </devices>
Nov 14 19:24:51 user nova-compute[75205]: </domain>
Nov 14 19:24:51 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1665402174',display_name='tempest-ServersNegativeTestJSON-server-1665402174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1665402174',id=36,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80601810103b45acaf3c28a876fb51d8',ramdisk_id='',reservation_id='r-asrbfx0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-405327324',owner_user_name='tempest-ServersNegativeTestJSON-405327324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:24:50Z,user_data=None,user_id='406f12b163cb4a989209213026aae994',uuid=e59c991e-1921-4e71-8680-b8ceb4f3ccf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "address": "fa:16:3e:69:c6:51", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a242ef-40", "ovs_interfaceid": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converting VIF {"id": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "address": "fa:16:3e:69:c6:51", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a242ef-40", "ovs_interfaceid": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c6:51,bridge_name='br-int',has_traffic_filtering=True,id=80a242ef-40ae-4609-b6bb-dc5c169c7f0c,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a242ef-40') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG os_vif [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c6:51,bridge_name='br-int',has_traffic_filtering=True,id=80a242ef-40ae-4609-b6bb-dc5c169c7f0c,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a242ef-40') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a37fe26-4cd9-5eef-9a6c-a296ebdf4c3c', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80a242ef-40, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80a242ef-40, col_values=(('qos', UUID('1d62c1cb-ef04-4a71-8a48-7ff411972705')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80a242ef-40, col_values=(('external_ids', {'iface-id': '80a242ef-40ae-4609-b6bb-dc5c169c7f0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:c6:51', 'vm-uuid': 'e59c991e-1921-4e71-8680-b8ceb4f3ccf2'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:51 user nova-compute[75205]: INFO os_vif [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c6:51,bridge_name='br-int',has_traffic_filtering=True,id=80a242ef-40ae-4609-b6bb-dc5c169c7f0c,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a242ef-40')
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] No VIF found with MAC fa:16:3e:69:c6:51, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.network.neutron [req-403812c5-84f6-4d04-9a9a-19111590e9d3 req-2c4d749e-1635-4e37-ab14-973fa4c11945 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Updated VIF entry in instance network info cache for port 80a242ef-40ae-4609-b6bb-dc5c169c7f0c. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG nova.network.neutron [req-403812c5-84f6-4d04-9a9a-19111590e9d3 req-2c4d749e-1635-4e37-ab14-973fa4c11945 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Updating instance_info_cache with network_info: [{"id": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "address": "fa:16:3e:69:c6:51", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a242ef-40", "ovs_interfaceid": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:24:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-403812c5-84f6-4d04-9a9a-19111590e9d3 req-2c4d749e-1635-4e37-ab14-973fa4c11945 service nova] Releasing lock "refresh_cache-e59c991e-1921-4e71-8680-b8ceb4f3ccf2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:24:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-88ce04b2-6342-4d93-994c-f01f0d3d0602 req-45ebf33a-d4be-4ec7-982e-6744df3f4331 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Received event network-vif-plugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88ce04b2-6342-4d93-994c-f01f0d3d0602 req-45ebf33a-d4be-4ec7-982e-6744df3f4331 service nova] Acquiring lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88ce04b2-6342-4d93-994c-f01f0d3d0602 req-45ebf33a-d4be-4ec7-982e-6744df3f4331 service nova] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88ce04b2-6342-4d93-994c-f01f0d3d0602 req-45ebf33a-d4be-4ec7-982e-6744df3f4331 service nova] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-88ce04b2-6342-4d93-994c-f01f0d3d0602 req-45ebf33a-d4be-4ec7-982e-6744df3f4331 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] No waiting events found dispatching network-vif-plugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:24:53 user nova-compute[75205]: WARNING nova.compute.manager [req-88ce04b2-6342-4d93-994c-f01f0d3d0602 req-45ebf33a-d4be-4ec7-982e-6744df3f4331 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Received unexpected event network-vif-plugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c for instance with vm_state building and task_state spawning.
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:24:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Instance spawned successfully.
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:24:55 user nova-compute[75205]: INFO nova.compute.manager [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-4ddc86cd-831b-463b-8f3c-e6fdb08426de req-f0d0e15d-2323-4317-b0aa-2bd007feda62 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Received event network-vif-plugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4ddc86cd-831b-463b-8f3c-e6fdb08426de req-f0d0e15d-2323-4317-b0aa-2bd007feda62 service nova] Acquiring lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4ddc86cd-831b-463b-8f3c-e6fdb08426de req-f0d0e15d-2323-4317-b0aa-2bd007feda62 service nova] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4ddc86cd-831b-463b-8f3c-e6fdb08426de req-f0d0e15d-2323-4317-b0aa-2bd007feda62 service nova] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-4ddc86cd-831b-463b-8f3c-e6fdb08426de req-f0d0e15d-2323-4317-b0aa-2bd007feda62 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] No waiting events found dispatching network-vif-plugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:24:55 user nova-compute[75205]: WARNING nova.compute.manager [req-4ddc86cd-831b-463b-8f3c-e6fdb08426de req-f0d0e15d-2323-4317-b0aa-2bd007feda62 service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Received unexpected event network-vif-plugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c for instance with vm_state building and task_state spawning.
Nov 14 19:24:55 user nova-compute[75205]: INFO nova.compute.manager [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Took 6.07 seconds to build instance.
Nov 14 19:24:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-51849c2d-e59c-473d-976b-a8fc7c739fc7 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.158s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:24:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:24:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "a61f9690-6f49-4ba0-8258-599e4e5cc917" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:08 user nova-compute[75205]: DEBUG nova.compute.manager [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:25:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:08 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:25:08 user nova-compute[75205]: INFO nova.compute.claims [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Claim successful on node user
Nov 14 19:25:09 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG nova.network.neutron [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:25:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:25:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG nova.policy [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06b3b7a0f2ae441f8cb1d50891fcab94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fe039dc34949509e4ad72cd9da3bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:25:09 user nova-compute[75205]: INFO nova.virt.block_device [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Booting with volume 5384e6fc-7619-469f-8b8d-0a8cfdaa350c at /dev/vda
Nov 14 19:25:09 user nova-compute[75205]: DEBUG os_brick.utils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[766e6bd3-66f1-465e-b207-48ddbfa8dd4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeb05e2-29fd-47e7-94e3-2d911d5f8aa5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a661a3-061e-4a79-9911-9da3c4500b24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[be12ad37-f3db-4c36-a641-90e78fd28e22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:25:09 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:25:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adab374-bc41-4b8d-9b29-064e7afc2e9a]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG os_brick.utils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:25:09 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Updating existing volume attachment record: d394ab1b-7286-439e-965a-7f36de26b99c {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:25:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Successfully created port: eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:25:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Successfully updated port: eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:25:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "refresh_cache-a61f9690-6f49-4ba0-8258-599e4e5cc917" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:25:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquired lock "refresh_cache-a61f9690-6f49-4ba0-8258-599e4e5cc917" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:25:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:25:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-ebf783d0-0d01-45c0-ad36-7302f6a7e9ba req-0b5a7113-b4a1-43a1-8a1b-b81ac5cf7ee1 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received event network-changed-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:25:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-ebf783d0-0d01-45c0-ad36-7302f6a7e9ba req-0b5a7113-b4a1-43a1-8a1b-b81ac5cf7ee1 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Refreshing instance network info cache due to event network-changed-eea2ded2-5c0b-42b6-aead-a65f7cc324bc. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:25:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ebf783d0-0d01-45c0-ad36-7302f6a7e9ba req-0b5a7113-b4a1-43a1-8a1b-b81ac5cf7ee1 service nova] Acquiring lock "refresh_cache-a61f9690-6f49-4ba0-8258-599e4e5cc917" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:25:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:25:11 user nova-compute[75205]: DEBUG nova.network.neutron [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Updating instance_info_cache with network_info: [{"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:25:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Releasing lock "refresh_cache-a61f9690-6f49-4ba0-8258-599e4e5cc917" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:25:11 user nova-compute[75205]: DEBUG nova.compute.manager [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Instance network_info: |[{"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:25:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ebf783d0-0d01-45c0-ad36-7302f6a7e9ba req-0b5a7113-b4a1-43a1-8a1b-b81ac5cf7ee1 service nova] Acquired lock "refresh_cache-a61f9690-6f49-4ba0-8258-599e4e5cc917" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:25:11 user nova-compute[75205]: DEBUG nova.network.neutron [req-ebf783d0-0d01-45c0-ad36-7302f6a7e9ba req-0b5a7113-b4a1-43a1-8a1b-b81ac5cf7ee1 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Refreshing network info cache for port eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:25:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:11 user nova-compute[75205]: DEBUG nova.network.neutron [req-ebf783d0-0d01-45c0-ad36-7302f6a7e9ba req-0b5a7113-b4a1-43a1-8a1b-b81ac5cf7ee1 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Updated VIF entry in instance network info cache for port eea2ded2-5c0b-42b6-aead-a65f7cc324bc. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:25:11 user nova-compute[75205]: DEBUG nova.network.neutron [req-ebf783d0-0d01-45c0-ad36-7302f6a7e9ba req-0b5a7113-b4a1-43a1-8a1b-b81ac5cf7ee1 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Updating instance_info_cache with network_info: [{"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:25:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ebf783d0-0d01-45c0-ad36-7302f6a7e9ba req-0b5a7113-b4a1-43a1-8a1b-b81ac5cf7ee1 service nova] Releasing lock "refresh_cache-a61f9690-6f49-4ba0-8258-599e4e5cc917" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:25:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:25:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Creating image(s)
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Ensure instance console log exists: /opt/stack/data/nova/instances/a61f9690-6f49-4ba0-8258-599e4e5cc917/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Start _get_guest_xml network_info=[{"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EiByouVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a61f9690-6f49-4ba0-8258-599e4e5cc917', 'attached_at': '', 'detached_at': '', 'volume_id': '5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 'serial': '5384e6fc-7619-469f-8b8d-0a8cfdaa350c'}, 'attachment_id': 'd394ab1b-7286-439e-965a-7f36de26b99c', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:25:14 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:25:14 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EiByouVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:25:14 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:25:14 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:25:14 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd73d09-f38b-44e7-9284-a9c282e21627]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:25:14 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5603a59e-de36-4dd5-b9ab-0eec6d8ab1da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c] added
Nov 14 19:25:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be19e31-a9e5-4d75-931b-aeae56d2148f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6c2d89-4c7d-408c-8c31-7c1dddbb6682]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EiByouVP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EiByouVP" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[11601684-826d-483b-883d-fddffe5837a0]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EiByouVP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b2fe62-1bf9-477c-be86-9bc99a8744a9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e4fc99-6610-4de9-9d9d-8acb383cee34]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a281055-f7ca-4346-8925-0da1f4e2dd33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260]
Nov 14 19:25:14 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260] successful.
Nov 14 19:25:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaaac77-e872-445c-b60b-f13efc52d309]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11a7091-d485-4db2-8d0d-9e27344669c2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:25:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:25:14 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:25:14 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cb09b0-8b93-43cd-9881-111b51ffadec]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:25:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EiByouVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:15 user nova-compute[75205]: INFO nova.compute.manager [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Unshelving
Nov 14 19:25:15 user nova-compute[75205]: INFO nova.virt.block_device [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Booting with volume edc77529-7a26-43d4-873a-d6fe5adb93a8 at /dev/vdc
Nov 14 19:25:15 user nova-compute[75205]: DEBUG os_brick.utils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff66dc5f-3f23-4808-a339-3a7cd715db82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be4daaa-b89b-4d51-bdd3-e4cf813af2bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7aba6f-4a31-4f3f-a50a-1fc596a26f66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2ed231-ee02-455a-bebf-de1320743791]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:25:15 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:25:15 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e417c5a1-7ad5-4183-9316-c06533170a2a]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG os_brick.utils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating existing volume attachment record: 4fb0f80d-c3d6-4601-823f-9f00ba628569 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23466383763393266', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466383763393266', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-668820460',display_name='tempest-TestVolumeBootPattern-server-668820460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-668820460',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4lflwSUeyVbH81QiQ0Uh3cKzramHeRM7aduqUtZ4pb3+SjiUT5tItPthN7NGlihkCZ2OzXolgwmiBolVRT+jaN4ru1XGIc7ZtqCPOyOWGe8i2eYeT/Jps/FMv13SMF/w==',key_name='tempest-TestVolumeBootPattern-186737572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-to41uxu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:25:10Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=a61f9690-6f49-4ba0-8258-599e4e5cc917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=eea2ded2-5c0b-42b6-aead-a65f7cc324bc,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea2ded2-5c') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'pci_devices' on Instance uuid a61f9690-6f49-4ba0-8258-599e4e5cc917 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:25:15 user nova-compute[75205]:   <uuid>a61f9690-6f49-4ba0-8258-599e4e5cc917</uuid>
Nov 14 19:25:15 user nova-compute[75205]:   <name>instance-00000025</name>
Nov 14 19:25:15 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:25:15 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:25:15 user nova-compute[75205]:   <metadata>
Nov 14 19:25:15 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:25:15 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:25:15 user nova-compute[75205]:       <nova:name>tempest-TestVolumeBootPattern-server-668820460</nova:name>
Nov 14 19:25:15 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:25:14</nova:creationTime>
Nov 14 19:25:15 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:25:15 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:25:15 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:25:15 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:25:15 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:25:15 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:25:15 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:25:15 user nova-compute[75205]:       <nova:owner>
Nov 14 19:25:15 user nova-compute[75205]:         <nova:user uuid="06b3b7a0f2ae441f8cb1d50891fcab94">tempest-TestVolumeBootPattern-397278786-project-member</nova:user>
Nov 14 19:25:15 user nova-compute[75205]:         <nova:project uuid="e2fe039dc34949509e4ad72cd9da3bf1">tempest-TestVolumeBootPattern-397278786</nova:project>
Nov 14 19:25:15 user nova-compute[75205]:       </nova:owner>
Nov 14 19:25:15 user nova-compute[75205]:       <nova:ports>
Nov 14 19:25:15 user nova-compute[75205]:         <nova:port uuid="eea2ded2-5c0b-42b6-aead-a65f7cc324bc">
Nov 14 19:25:15 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 19:25:15 user nova-compute[75205]:         </nova:port>
Nov 14 19:25:15 user nova-compute[75205]:       </nova:ports>
Nov 14 19:25:15 user nova-compute[75205]:     </nova:instance>
Nov 14 19:25:15 user nova-compute[75205]:   </metadata>
Nov 14 19:25:15 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:25:15 user nova-compute[75205]:     <system>
Nov 14 19:25:15 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:25:15 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:25:15 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:25:15 user nova-compute[75205]:       <entry name="serial">a61f9690-6f49-4ba0-8258-599e4e5cc917</entry>
Nov 14 19:25:15 user nova-compute[75205]:       <entry name="uuid">a61f9690-6f49-4ba0-8258-599e4e5cc917</entry>
Nov 14 19:25:15 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:25:15 user nova-compute[75205]:     </system>
Nov 14 19:25:15 user nova-compute[75205]:   </sysinfo>
Nov 14 19:25:15 user nova-compute[75205]:   <os>
Nov 14 19:25:15 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:25:15 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:25:15 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:25:15 user nova-compute[75205]:   </os>
Nov 14 19:25:15 user nova-compute[75205]:   <features>
Nov 14 19:25:15 user nova-compute[75205]:     <acpi/>
Nov 14 19:25:15 user nova-compute[75205]:     <apic/>
Nov 14 19:25:15 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:25:15 user nova-compute[75205]:   </features>
Nov 14 19:25:15 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:25:15 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:25:15 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:25:15 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:25:15 user nova-compute[75205]:   </clock>
Nov 14 19:25:15 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:25:15 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:25:15 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:25:15 user nova-compute[75205]:   </cpu>
Nov 14 19:25:15 user nova-compute[75205]:   <devices>
Nov 14 19:25:15 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:25:15 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:25:15 user nova-compute[75205]:       <source dev="/dev/sdc"/>
Nov 14 19:25:15 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:25:15 user nova-compute[75205]:       <serial>5384e6fc-7619-469f-8b8d-0a8cfdaa350c</serial>
Nov 14 19:25:15 user nova-compute[75205]:     </disk>
Nov 14 19:25:15 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:25:15 user nova-compute[75205]:       <mac address="fa:16:3e:bb:04:84"/>
Nov 14 19:25:15 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:25:15 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:25:15 user nova-compute[75205]:       <target dev="tapeea2ded2-5c"/>
Nov 14 19:25:15 user nova-compute[75205]:     </interface>
Nov 14 19:25:15 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:25:15 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/a61f9690-6f49-4ba0-8258-599e4e5cc917/console.log" append="off"/>
Nov 14 19:25:15 user nova-compute[75205]:     </serial>
Nov 14 19:25:15 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:25:15 user nova-compute[75205]:     <video>
Nov 14 19:25:15 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:25:15 user nova-compute[75205]:     </video>
Nov 14 19:25:15 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:25:15 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:25:15 user nova-compute[75205]:     </rng>
Nov 14 19:25:15 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:25:15 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:25:15 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:25:15 user nova-compute[75205]:     </memballoon>
Nov 14 19:25:15 user nova-compute[75205]:   </devices>
Nov 14 19:25:15 user nova-compute[75205]: </domain>
Nov 14 19:25:15 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-668820460',display_name='tempest-TestVolumeBootPattern-server-668820460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-668820460',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4lflwSUeyVbH81QiQ0Uh3cKzramHeRM7aduqUtZ4pb3+SjiUT5tItPthN7NGlihkCZ2OzXolgwmiBolVRT+jaN4ru1XGIc7ZtqCPOyOWGe8i2eYeT/Jps/FMv13SMF/w==',key_name='tempest-TestVolumeBootPattern-186737572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-to41uxu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:25:10Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=a61f9690-6f49-4ba0-8258-599e4e5cc917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=eea2ded2-5c0b-42b6-aead-a65f7cc324bc,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea2ded2-5c') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG os_vif [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=eea2ded2-5c0b-42b6-aead-a65f7cc324bc,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea2ded2-5c') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01270332-7127-5835-84eb-99dc9576fe23', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeea2ded2-5c, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeea2ded2-5c, col_values=(('qos', UUID('a51a2bea-9f9b-4373-92d5-3e5063e48e51')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeea2ded2-5c, col_values=(('external_ids', {'iface-id': 'eea2ded2-5c0b-42b6-aead-a65f7cc324bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:04:84', 'vm-uuid': 'a61f9690-6f49-4ba0-8258-599e4e5cc917'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:15 user nova-compute[75205]: INFO os_vif [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=eea2ded2-5c0b-42b6-aead-a65f7cc324bc,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea2ded2-5c')
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:25:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No VIF found with MAC fa:16:3e:bb:04:84, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:25:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-02fcfa3a-f335-4647-a1e9-01f068fe6ff3 req-a5ffe9a9-b523-46b7-a01f-25ae48fe00c4 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received event network-vif-plugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:25:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-02fcfa3a-f335-4647-a1e9-01f068fe6ff3 req-a5ffe9a9-b523-46b7-a01f-25ae48fe00c4 service nova] Acquiring lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-02fcfa3a-f335-4647-a1e9-01f068fe6ff3 req-a5ffe9a9-b523-46b7-a01f-25ae48fe00c4 service nova] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-02fcfa3a-f335-4647-a1e9-01f068fe6ff3 req-a5ffe9a9-b523-46b7-a01f-25ae48fe00c4 service nova] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-02fcfa3a-f335-4647-a1e9-01f068fe6ff3 req-a5ffe9a9-b523-46b7-a01f-25ae48fe00c4 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] No waiting events found dispatching network-vif-plugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:25:17 user nova-compute[75205]: WARNING nova.compute.manager [req-02fcfa3a-f335-4647-a1e9-01f068fe6ff3 req-a5ffe9a9-b523-46b7-a01f-25ae48fe00c4 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received unexpected event network-vif-plugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc for instance with vm_state building and task_state spawning.
Nov 14 19:25:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:25:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Instance spawned successfully.
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:25:19 user nova-compute[75205]: INFO nova.compute.manager [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-e7595502-c6b7-45a2-8441-270d11529858 req-b4a55ed8-4487-4411-bd91-6f0aa5231b51 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received event network-vif-plugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e7595502-c6b7-45a2-8441-270d11529858 req-b4a55ed8-4487-4411-bd91-6f0aa5231b51 service nova] Acquiring lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e7595502-c6b7-45a2-8441-270d11529858 req-b4a55ed8-4487-4411-bd91-6f0aa5231b51 service nova] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e7595502-c6b7-45a2-8441-270d11529858 req-b4a55ed8-4487-4411-bd91-6f0aa5231b51 service nova] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-e7595502-c6b7-45a2-8441-270d11529858 req-b4a55ed8-4487-4411-bd91-6f0aa5231b51 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] No waiting events found dispatching network-vif-plugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:25:19 user nova-compute[75205]: WARNING nova.compute.manager [req-e7595502-c6b7-45a2-8441-270d11529858 req-b4a55ed8-4487-4411-bd91-6f0aa5231b51 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received unexpected event network-vif-plugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc for instance with vm_state building and task_state spawning.
Nov 14 19:25:19 user nova-compute[75205]: INFO nova.compute.manager [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Took 10.43 seconds to build instance.
Nov 14 19:25:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-99bbab03-40fe-42c5-9e59-d385dde0ec47 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.523s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG nova.objects.instance [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'pci_requests' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG nova.objects.instance [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'numa_topology' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:25:20 user nova-compute[75205]: INFO nova.compute.claims [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Claim successful on node user
Nov 14 19:25:20 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Refreshing inventories for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Updating ProviderTree inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Refreshing aggregate associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, aggregates: None {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Refreshing trait associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, traits: HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:25:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:20 user nova-compute[75205]: INFO nova.network.neutron [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating port 9e59c6ca-9156-4128-bcff-efbf329ac5c6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquired lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-f3ded775-bb3d-4fc8-8ea8-486930dc0a38 req-af428e32-6316-48df-8ff5-0b848941892a service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-changed-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-f3ded775-bb3d-4fc8-8ea8-486930dc0a38 req-af428e32-6316-48df-8ff5-0b848941892a service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Refreshing instance network info cache due to event network-changed-9e59c6ca-9156-4128-bcff-efbf329ac5c6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f3ded775-bb3d-4fc8-8ea8-486930dc0a38 req-af428e32-6316-48df-8ff5-0b848941892a service nova] Acquiring lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating instance_info_cache with network_info: [{"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Releasing lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:25:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Creating image(s)
Nov 14 19:25:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "/opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "/opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG nova.objects.instance [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f3ded775-bb3d-4fc8-8ea8-486930dc0a38 req-af428e32-6316-48df-8ff5-0b848941892a service nova] Acquired lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-f3ded775-bb3d-4fc8-8ea8-486930dc0a38 req-af428e32-6316-48df-8ff5-0b848941892a service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Refreshing network info cache for port 9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG nova.objects.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Object Instance<6e5b652c-e7bf-4b77-bb84-db5c399cb538> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "2dd6d4573eab05707cf804e45aad79f0d0c6a401" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "2dd6d4573eab05707cf804e45aad79f0d0c6a401" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401.part --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:22 user nova-compute[75205]: DEBUG nova.virt.images [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] 59e9a68d-0109-4fa0-83ac-8fd83c5539c0 was qcow2, converting to raw {{(pid=75205) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 19:25:22 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:25:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401.part /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401.converted {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-f3ded775-bb3d-4fc8-8ea8-486930dc0a38 req-af428e32-6316-48df-8ff5-0b848941892a service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updated VIF entry in instance network info cache for port 9e59c6ca-9156-4128-bcff-efbf329ac5c6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:25:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-f3ded775-bb3d-4fc8-8ea8-486930dc0a38 req-af428e32-6316-48df-8ff5-0b848941892a service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating instance_info_cache with network_info: [{"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:25:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f3ded775-bb3d-4fc8-8ea8-486930dc0a38 req-af428e32-6316-48df-8ff5-0b848941892a service nova] Releasing lock "refresh_cache-6e5b652c-e7bf-4b77-bb84-db5c399cb538" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401.part /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401.converted" returned: 0 in 0.353s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401.converted --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "2dd6d4573eab05707cf804e45aad79f0d0c6a401" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.495s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401 --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401 --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "2dd6d4573eab05707cf804e45aad79f0d0c6a401" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "2dd6d4573eab05707cf804e45aad79f0d0c6a401" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401 --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401 --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401,backing_fmt=raw /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401,backing_fmt=raw /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk 1073741824" returned: 0 in 0.048s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "2dd6d4573eab05707cf804e45aad79f0d0c6a401" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:23 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401 --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401 --force-share --output=json" returned: 0 in 0.216s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:24 user nova-compute[75205]: DEBUG nova.objects.instance [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'migration_context' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:25:24 user nova-compute[75205]: DEBUG nova.objects.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Object Instance<6e5b652c-e7bf-4b77-bb84-db5c399cb538> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:25:24 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Rebasing disk image.
Nov 14 19:25:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.267s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:24 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de -F raw /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:26 user nova-compute[75205]: INFO nova.compute.manager [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Terminating instance
Nov 14 19:25:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-88421133-bc08-4888-9569-a71d1ec47f4f req-206e61f9-feea-44e1-a831-6b39a1c8c9f8 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88421133-bc08-4888-9569-a71d1ec47f4f req-206e61f9-feea-44e1-a831-6b39a1c8c9f8 service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88421133-bc08-4888-9569-a71d1ec47f4f req-206e61f9-feea-44e1-a831-6b39a1c8c9f8 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-88421133-bc08-4888-9569-a71d1ec47f4f req-206e61f9-feea-44e1-a831-6b39a1c8c9f8 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-88421133-bc08-4888-9569-a71d1ec47f4f req-206e61f9-feea-44e1-a831-6b39a1c8c9f8 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-88421133-bc08-4888-9569-a71d1ec47f4f req-206e61f9-feea-44e1-a831-6b39a1c8c9f8 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-unplugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:25:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:27 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Instance destroyed successfully.
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.objects.instance [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'resources' on Instance uuid 1ec04cbd-a532-4e15-ba88-a87e6d41e249 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1344472545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1344472545',id=31,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:21:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-rf8l979h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:23:40Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=1ec04cbd-a532-4e15-ba88-a87e6d41e249,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "address": "fa:16:3e:53:48:58", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5f1ef2-eb", "ovs_interfaceid": "ad5f1ef2-ebe2-4f5f-8777-891848473af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:48:58,bridge_name='br-int',has_traffic_filtering=True,id=ad5f1ef2-ebe2-4f5f-8777-891848473af2,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5f1ef2-eb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_vif [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:48:58,bridge_name='br-int',has_traffic_filtering=True,id=ad5f1ef2-ebe2-4f5f-8777-891848473af2,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5f1ef2-eb') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad5f1ef2-eb, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c34cbf6-16b8-4bde-bcae-d5a838ff7ef6) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:27 user nova-compute[75205]: INFO os_vif [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:48:58,bridge_name='br-int',has_traffic_filtering=True,id=ad5f1ef2-ebe2-4f5f-8777-891848473af2,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5f1ef2-eb')
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPxeWdfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:25:27 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de -F raw /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk" returned: 0 in 3.154s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Ensure instance console log exists: /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Start _get_guest_xml network_info=[{"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='12fa0b1734e2eba113dd8e9fc08eb9aa',container_format='bare',created_at=2023-11-14T19:23:23Z,direct_url=<?>,disk_format='qcow2',id=59e9a68d-0109-4fa0-83ac-8fd83c5539c0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1591317232-shelved',owner='1bce9c4222254fe688cb54f69fe7bc4a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T19:23:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRdEKCrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6e5b652c-e7bf-4b77-bb84-db5c399cb538', 'attached_at': '', 'detached_at': '', 'volume_id': 'edc77529-7a26-43d4-873a-d6fe5adb93a8', 'serial': 'edc77529-7a26-43d4-873a-d6fe5adb93a8'}, 'attachment_id': '4fb0f80d-c3d6-4601-823f-9f00ba628569', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd5236-bd64-49bd-9dd9-5c593b216089]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:25:27 user nova-compute[75205]: No targets found.
Nov 14 19:25:27 user nova-compute[75205]: iSNS:
Nov 14 19:25:27 user nova-compute[75205]: No targets found.
Nov 14 19:25:27 user nova-compute[75205]: STATIC:
Nov 14 19:25:27 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:25:27 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:25:27 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:25:27 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4
Nov 14 19:25:27 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:25:27 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:25:27 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c
Nov 14 19:25:27 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:25:27 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:25:27 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0
Nov 14 19:25:27 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:25:27 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:25:27 user nova-compute[75205]: FIRMWARE:
Nov 14 19:25:27 user nova-compute[75205]: No targets found.
Nov 14 19:25:27 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:25:27 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:25:27 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:25:27 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='12fa0b1734e2eba113dd8e9fc08eb9aa',container_format='bare',created_at=2023-11-14T19:23:23Z,direct_url=<?>,disk_format='qcow2',id=59e9a68d-0109-4fa0-83ac-8fd83c5539c0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1591317232-shelved',owner='1bce9c4222254fe688cb54f69fe7bc4a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T19:23:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.objects.instance [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f5f4e0-c459-4a56-a64f-08bad4eb8a8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.objects.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Object Instance<6e5b652c-e7bf-4b77-bb84-db5c399cb538> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRdEKCrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:25:27 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e7ed6f-aeff-4f47-82f7-0096868363f4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:25:27 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:25:27 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:25:27 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:25:27 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:25:27 user nova-compute[75205]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 (non-flash)
Nov 14 19:25:27 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:25:27 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:25:27 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb94b39ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0'): ({'sdd'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Removing single pathed devices sdd {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4957b-b05d-467c-a73e-3f42aebde06c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1cb7cc-29b4-4a4d-bd54-6eebe897c822]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flushing IO for device /dev/sdd {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f196d20-4ec6-4a99-8c4c-4970a4461fac]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36ac318-748d-4f87-ab50-3dbff49bd1eb]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26436366362376531', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f98b60f8', '/dev/disk/by-id/scsi-1SCST_BIOf98b60f8-d66cb7e1422ecf55') {{(pid=85714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09f7c21-36a7-4ef8-9d69-45af4e7b4ec2]: (4, None) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[791f378e-75e0-4954-a150-4e3d8ffb27e5]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6592176-8f69-4e2b-be4c-124a5aa80f53]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0, portal: 172.16.0.220,3260]
Nov 14 19:25:27 user nova-compute[75205]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0, portal: 172.16.0.220,3260] successful.
Nov 14 19:25:27 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616c6c6f-cd8b-44fb-8956-d010e71b92e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[473c1c48-bec1-40cb-af5a-b05362e6ea1e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] <== disconnect_volume: return (363ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:25:27 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Deleting instance files /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249_del
Nov 14 19:25:27 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Deletion of /opt/stack/data/nova/instances/1ec04cbd-a532-4e15-ba88-a87e6d41e249_del complete
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.255s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:25:27 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:25:27 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab3abae-6cf4-4bf0-b076-daccccb188ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:25:27 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[28284367-db56-425e-9c4d-13dc979cb009]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8] added
Nov 14 19:25:27 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: INFO nova.compute.manager [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2c8a2c-dbf6-4ca1-8ecf-c2bdc9ff6b93]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d212ec4-1974-4575-9d34-9640a3c77f9b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRdEKCrD {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRdEKCrD" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2685c757-6290-41c7-8d45-8865f5c6227f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SRdEKCrD'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86a0000-7b9a-4241-8178-9f250ab18d7a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b639d8e7-237d-4723-bc5f-7d4bc7f8fa75]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:25:27 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:25:27 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:25:27 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:25:27 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:25:27 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:25:27 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:25:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f71f33d-68b3-45b4-82ff-24c12e4b2573]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8, portal: 172.16.0.220,3260]
Nov 14 19:25:28 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8, portal: 172.16.0.220,3260] successful.
Nov 14 19:25:28 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8143bd6e-9626-4a87-bf87-269c3f05b67a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc3f3f6-4846-485f-b0ab-11f56eec317f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:25:28 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:25:28 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:25:28 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:25:28 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:25:28 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:25:28 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:25:28 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:25:28 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a680b9a-1d70-4f92-b5aa-c635f9850285]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRdEKCrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:25:28 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Took 0.69 seconds to deallocate network for instance.
Nov 14 19:25:28 user nova-compute[75205]: DEBUG nova.compute.manager [req-caa4f17b-1f85-49d9-a738-a51d3ced9748 req-5cf92132-3ff1-401e-92e3-c3fca8cefad4 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-caa4f17b-1f85-49d9-a738-a51d3ced9748 req-5cf92132-3ff1-401e-92e3-c3fca8cefad4 service nova] Acquiring lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-caa4f17b-1f85-49d9-a738-a51d3ced9748 req-5cf92132-3ff1-401e-92e3-c3fca8cefad4 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-caa4f17b-1f85-49d9-a738-a51d3ced9748 req-5cf92132-3ff1-401e-92e3-c3fca8cefad4 service nova] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:28 user nova-compute[75205]: DEBUG nova.compute.manager [req-caa4f17b-1f85-49d9-a738-a51d3ced9748 req-5cf92132-3ff1-401e-92e3-c3fca8cefad4 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] No waiting events found dispatching network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:25:28 user nova-compute[75205]: WARNING nova.compute.manager [req-caa4f17b-1f85-49d9-a738-a51d3ced9748 req-5cf92132-3ff1-401e-92e3-c3fca8cefad4 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received unexpected event network-vif-plugged-ad5f1ef2-ebe2-4f5f-8777-891848473af2 for instance with vm_state active and task_state deleting.
Nov 14 19:25:28 user nova-compute[75205]: DEBUG nova.compute.manager [req-caa4f17b-1f85-49d9-a738-a51d3ced9748 req-5cf92132-3ff1-401e-92e3-c3fca8cefad4 service nova] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Received event network-vif-deleted-ad5f1ef2-ebe2-4f5f-8777-891848473af2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] <== connect_volume: return (1567ms) {'type': 'block', 'scsi_wwn': '23331616631333935', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331616631333935', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1591317232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1591317232',id=33,image_ref='59e9a68d-0109-4fa0-83ac-8fd83c5539c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1469195162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-sjq8e8cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member',shelved_at='2023-11-14T19:23:27.406448',shelved_host='user',shelved_image_id='59e9a68d-0109-4fa0-83ac-8fd83c5539c0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=6e5b652c-e7bf-4b77-bb84-db5c399cb538,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.objects.instance [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.objects.base [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Object Instance<6e5b652c-e7bf-4b77-bb84-db5c399cb538> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:25:29 user nova-compute[75205]:   <uuid>6e5b652c-e7bf-4b77-bb84-db5c399cb538</uuid>
Nov 14 19:25:29 user nova-compute[75205]:   <name>instance-00000021</name>
Nov 14 19:25:29 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:25:29 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:25:29 user nova-compute[75205]:   <metadata>
Nov 14 19:25:29 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:25:29 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:25:29 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1591317232</nova:name>
Nov 14 19:25:29 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:25:27</nova:creationTime>
Nov 14 19:25:29 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:25:29 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:25:29 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:25:29 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:25:29 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:25:29 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:25:29 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:25:29 user nova-compute[75205]:       <nova:owner>
Nov 14 19:25:29 user nova-compute[75205]:         <nova:user uuid="b3e0b9e41b584048ae0c868ec72e89a0">tempest-AttachVolumeShelveTestJSON-707756004-project-member</nova:user>
Nov 14 19:25:29 user nova-compute[75205]:         <nova:project uuid="1bce9c4222254fe688cb54f69fe7bc4a">tempest-AttachVolumeShelveTestJSON-707756004</nova:project>
Nov 14 19:25:29 user nova-compute[75205]:       </nova:owner>
Nov 14 19:25:29 user nova-compute[75205]:       <nova:root type="image" uuid="59e9a68d-0109-4fa0-83ac-8fd83c5539c0"/>
Nov 14 19:25:29 user nova-compute[75205]:       <nova:ports>
Nov 14 19:25:29 user nova-compute[75205]:         <nova:port uuid="9e59c6ca-9156-4128-bcff-efbf329ac5c6">
Nov 14 19:25:29 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 19:25:29 user nova-compute[75205]:         </nova:port>
Nov 14 19:25:29 user nova-compute[75205]:       </nova:ports>
Nov 14 19:25:29 user nova-compute[75205]:     </nova:instance>
Nov 14 19:25:29 user nova-compute[75205]:   </metadata>
Nov 14 19:25:29 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:25:29 user nova-compute[75205]:     <system>
Nov 14 19:25:29 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:25:29 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:25:29 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:25:29 user nova-compute[75205]:       <entry name="serial">6e5b652c-e7bf-4b77-bb84-db5c399cb538</entry>
Nov 14 19:25:29 user nova-compute[75205]:       <entry name="uuid">6e5b652c-e7bf-4b77-bb84-db5c399cb538</entry>
Nov 14 19:25:29 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:25:29 user nova-compute[75205]:     </system>
Nov 14 19:25:29 user nova-compute[75205]:   </sysinfo>
Nov 14 19:25:29 user nova-compute[75205]:   <os>
Nov 14 19:25:29 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:25:29 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:25:29 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:25:29 user nova-compute[75205]:   </os>
Nov 14 19:25:29 user nova-compute[75205]:   <features>
Nov 14 19:25:29 user nova-compute[75205]:     <acpi/>
Nov 14 19:25:29 user nova-compute[75205]:     <apic/>
Nov 14 19:25:29 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:25:29 user nova-compute[75205]:   </features>
Nov 14 19:25:29 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:25:29 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:25:29 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:25:29 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:25:29 user nova-compute[75205]:   </clock>
Nov 14 19:25:29 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:25:29 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:25:29 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:25:29 user nova-compute[75205]:   </cpu>
Nov 14 19:25:29 user nova-compute[75205]:   <devices>
Nov 14 19:25:29 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:25:29 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:25:29 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk"/>
Nov 14 19:25:29 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:25:29 user nova-compute[75205]:     </disk>
Nov 14 19:25:29 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:25:29 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:25:29 user nova-compute[75205]:       <source dev="/dev/sdd"/>
Nov 14 19:25:29 user nova-compute[75205]:       <target dev="vdc" bus="virtio"/>
Nov 14 19:25:29 user nova-compute[75205]:       <serial>edc77529-7a26-43d4-873a-d6fe5adb93a8</serial>
Nov 14 19:25:29 user nova-compute[75205]:     </disk>
Nov 14 19:25:29 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:25:29 user nova-compute[75205]:       <mac address="fa:16:3e:b7:a9:40"/>
Nov 14 19:25:29 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:25:29 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:25:29 user nova-compute[75205]:       <target dev="tap9e59c6ca-91"/>
Nov 14 19:25:29 user nova-compute[75205]:     </interface>
Nov 14 19:25:29 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:25:29 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/console.log" append="off"/>
Nov 14 19:25:29 user nova-compute[75205]:     </serial>
Nov 14 19:25:29 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:25:29 user nova-compute[75205]:     <video>
Nov 14 19:25:29 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:25:29 user nova-compute[75205]:     </video>
Nov 14 19:25:29 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:25:29 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:25:29 user nova-compute[75205]:     </rng>
Nov 14 19:25:29 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:25:29 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:25:29 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:25:29 user nova-compute[75205]:     </memballoon>
Nov 14 19:25:29 user nova-compute[75205]:   </devices>
Nov 14 19:25:29 user nova-compute[75205]: </domain>
Nov 14 19:25:29 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1591317232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1591317232',id=33,image_ref='59e9a68d-0109-4fa0-83ac-8fd83c5539c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1469195162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-sjq8e8cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member',shelved_at='2023-11-14T19:23:27.406448',shelved_host='user',shelved_image_id='59e9a68d-0109-4fa0-83ac-8fd83c5539c0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=6e5b652c-e7bf-4b77-bb84-db5c399cb538,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG os_vif [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b12c435-a8d1-54fd-9fbf-81bf743e0fcd', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e59c6ca-91, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e59c6ca-91, col_values=(('qos', UUID('cbdd7180-bcd5-44ee-9dad-672ee2c8d519')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e59c6ca-91, col_values=(('external_ids', {'iface-id': '9e59c6ca-9156-4128-bcff-efbf329ac5c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:a9:40', 'vm-uuid': '6e5b652c-e7bf-4b77-bb84-db5c399cb538'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:29 user nova-compute[75205]: INFO os_vif [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91')
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] No VIF found with MAC fa:16:3e:b7:a9:40, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:25:29 user nova-compute[75205]: INFO nova.compute.manager [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 1ec04cbd-a532-4e15-ba88-a87e6d41e249] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 19:25:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:25:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:29 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Deleted allocations for instance 1ec04cbd-a532-4e15-ba88-a87e6d41e249
Nov 14 19:25:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-bdd70151-2fbe-4db8-b0ff-a6e2ff7e6b60 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "1ec04cbd-a532-4e15-ba88-a87e6d41e249" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.348s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:30 user nova-compute[75205]: DEBUG nova.compute.manager [req-83a125b3-2180-44af-af55-44df115ae14b req-1ea6c548-610d-463d-876e-c5f81ee5aae2 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:25:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-83a125b3-2180-44af-af55-44df115ae14b req-1ea6c548-610d-463d-876e-c5f81ee5aae2 service nova] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-83a125b3-2180-44af-af55-44df115ae14b req-1ea6c548-610d-463d-876e-c5f81ee5aae2 service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-83a125b3-2180-44af-af55-44df115ae14b req-1ea6c548-610d-463d-876e-c5f81ee5aae2 service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:30 user nova-compute[75205]: DEBUG nova.compute.manager [req-83a125b3-2180-44af-af55-44df115ae14b req-1ea6c548-610d-463d-876e-c5f81ee5aae2 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] No waiting events found dispatching network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:25:30 user nova-compute[75205]: WARNING nova.compute.manager [req-83a125b3-2180-44af-af55-44df115ae14b req-1ea6c548-610d-463d-876e-c5f81ee5aae2 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received unexpected event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 19:25:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:25:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:25:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Instance spawned successfully.
Nov 14 19:25:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-83625fe0-3153-42b1-aecc-2162220a2d82 req-b1acb7c1-1aca-4906-a494-81bd7bbd54bb service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:25:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-83625fe0-3153-42b1-aecc-2162220a2d82 req-b1acb7c1-1aca-4906-a494-81bd7bbd54bb service nova] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-83625fe0-3153-42b1-aecc-2162220a2d82 req-b1acb7c1-1aca-4906-a494-81bd7bbd54bb service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-83625fe0-3153-42b1-aecc-2162220a2d82 req-b1acb7c1-1aca-4906-a494-81bd7bbd54bb service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-83625fe0-3153-42b1-aecc-2162220a2d82 req-b1acb7c1-1aca-4906-a494-81bd7bbd54bb service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] No waiting events found dispatching network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:25:32 user nova-compute[75205]: WARNING nova.compute.manager [req-83625fe0-3153-42b1-aecc-2162220a2d82 req-b1acb7c1-1aca-4906-a494-81bd7bbd54bb service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received unexpected event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 19:25:32 user nova-compute[75205]: DEBUG nova.compute.manager [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:25:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-72a9b29a-ffbc-4758-bcd0-6f131f56be5a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.717s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:33 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:25:33 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:25:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:34 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:25:34 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:25:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:34 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:25:34 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:25:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:25:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:25:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:25:39 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:25:39 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7698MB free_disk=24.866802215576172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 2a32bb26-deb4-407d-a9e9-31de887e0b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7260ad81-fc37-4726-8fee-9adecb58040f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance e59c991e-1921-4e71-8680-b8ceb4f3ccf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance a61f9690-6f49-4ba0-8258-599e4e5cc917 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:25:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:25:40 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:25:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:25:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:25:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:25:40 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:25:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Updating instance_info_cache with network_info: [{"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:25:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-41394628-10e9-4adc-8bd5-0eae6cfe1f8a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:25:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:25:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:25:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:25:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:25:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:25:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:43 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:25:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:25:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:26:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:26:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:26:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:26:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:26:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:26:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:26:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:26:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:26:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:26:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:26:16 user nova-compute[75205]: INFO nova.compute.claims [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Claim successful on node user
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "2a32bb26-deb4-407d-a9e9-31de887e0b38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:17 user nova-compute[75205]: INFO nova.compute.manager [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Terminating instance
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:26:17 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-a1e335d8-668d-4b3c-b68e-f3ccc59869a2 req-83e41464-d60c-44ba-b914-c79bd6d40c30 service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Received event network-vif-unplugged-527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a1e335d8-668d-4b3c-b68e-f3ccc59869a2 req-83e41464-d60c-44ba-b914-c79bd6d40c30 service nova] Acquiring lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a1e335d8-668d-4b3c-b68e-f3ccc59869a2 req-83e41464-d60c-44ba-b914-c79bd6d40c30 service nova] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a1e335d8-668d-4b3c-b68e-f3ccc59869a2 req-83e41464-d60c-44ba-b914-c79bd6d40c30 service nova] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-a1e335d8-668d-4b3c-b68e-f3ccc59869a2 req-83e41464-d60c-44ba-b914-c79bd6d40c30 service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] No waiting events found dispatching network-vif-unplugged-527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-a1e335d8-668d-4b3c-b68e-f3ccc59869a2 req-83e41464-d60c-44ba-b914-c79bd6d40c30 service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Received event network-vif-unplugged-527e37cf-145a-4e81-8849-0cba4a6d585b for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:26:17 user nova-compute[75205]: INFO nova.virt.block_device [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Booting with volume 788c1a35-e7c1-4da1-b718-549567f2da3a at /dev/vda
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.policy [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f89ca9b3c52040acbc46581ac5cf55b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55021da245654f6392681359d51cbc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG os_brick.utils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e0971f-ed77-46b2-b8c3-3eaeb5d5f80e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f085185-b1fb-48ad-98a6-eee8c5e09c11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ac9030-e90b-4d53-bae2-1661ec63d8bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fd7b07-07e4-4af3-bfa2-75ebcc890a80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:26:17 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f334de-f84e-4acf-a851-fe697f456dcc]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG os_brick.utils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating existing volume attachment record: 16261035-d127-4788-86a5-b1c993bbb925 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:26:17 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Instance destroyed successfully.
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.objects.instance [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'resources' on Instance uuid 2a32bb26-deb4-407d-a9e9-31de887e0b38 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437001077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437001077',id=26,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-6xfmcr5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:18:50Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=2a32bb26-deb4-407d-a9e9-31de887e0b38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "527e37cf-145a-4e81-8849-0cba4a6d585b", "address": "fa:16:3e:99:7e:13", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap527e37cf-14", "ovs_interfaceid": "527e37cf-145a-4e81-8849-0cba4a6d585b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "527e37cf-145a-4e81-8849-0cba4a6d585b", "address": "fa:16:3e:99:7e:13", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap527e37cf-14", "ovs_interfaceid": "527e37cf-145a-4e81-8849-0cba4a6d585b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:7e:13,bridge_name='br-int',has_traffic_filtering=True,id=527e37cf-145a-4e81-8849-0cba4a6d585b,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap527e37cf-14') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG os_vif [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:7e:13,bridge_name='br-int',has_traffic_filtering=True,id=527e37cf-145a-4e81-8849-0cba4a6d585b,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap527e37cf-14') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap527e37cf-14, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8645bf56-5a8f-4b19-9cf7-6fd09bbe375e) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:17 user nova-compute[75205]: INFO os_vif [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:7e:13,bridge_name='br-int',has_traffic_filtering=True,id=527e37cf-145a-4e81-8849-0cba4a6d585b,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap527e37cf-14')
Nov 14 19:26:17 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Deleting instance files /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38_del
Nov 14 19:26:17 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Deletion of /opt/stack/data/nova/instances/2a32bb26-deb4-407d-a9e9-31de887e0b38_del complete
Nov 14 19:26:17 user nova-compute[75205]: INFO nova.compute.manager [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 14 19:26:17 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:26:17 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Successfully created port: b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:18 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Took 0.58 seconds to deallocate network for instance.
Nov 14 19:26:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-c4be686c-bbe4-4d0b-913e-c9901318c60d req-a9635c3b-d8fd-415c-9a23-24f59bba437a service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Received event network-vif-deleted-527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Successfully updated port: b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquired lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:26:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:19 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Deleted allocations for instance 2a32bb26-deb4-407d-a9e9-31de887e0b38
Nov 14 19:26:19 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6d08db78-ce29-4d77-9fd6-5b61c7a21c18 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.831s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating instance_info_cache with network_info: [{"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Releasing lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Instance network_info: |[{"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Received event network-vif-plugged-527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] Acquiring lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] Lock "2a32bb26-deb4-407d-a9e9-31de887e0b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] No waiting events found dispatching network-vif-plugged-527e37cf-145a-4e81-8849-0cba4a6d585b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:26:19 user nova-compute[75205]: WARNING nova.compute.manager [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] [instance: 2a32bb26-deb4-407d-a9e9-31de887e0b38] Received unexpected event network-vif-plugged-527e37cf-145a-4e81-8849-0cba4a6d585b for instance with vm_state deleted and task_state None.
Nov 14 19:26:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-changed-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Refreshing instance network info cache due to event network-changed-b852cc39-4e71-4a5e-bbbd-6dfd30715442. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] Acquiring lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] Acquired lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Refreshing network info cache for port b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updated VIF entry in instance network info cache for port b852cc39-4e71-4a5e-bbbd-6dfd30715442. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG nova.network.neutron [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating instance_info_cache with network_info: [{"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:26:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2a0020d7-d22c-4934-824d-30cd606d4f27 req-ccab0295-19d9-4bdf-bdea-c38a0b8162cb service nova] Releasing lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:26:22 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Creating image(s)
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Ensure instance console log exists: /opt/stack/data/nova/instances/298a5eb2-6362-40bd-93fa-2cad9b07718a/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Start _get_guest_xml network_info=[{"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vImMOBrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '298a5eb2-6362-40bd-93fa-2cad9b07718a', 'attached_at': '', 'detached_at': '', 'volume_id': '788c1a35-e7c1-4da1-b718-549567f2da3a', 'serial': '788c1a35-e7c1-4da1-b718-549567f2da3a'}, 'attachment_id': '16261035-d127-4788-86a5-b1c993bbb925', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:26:22 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:26:22 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vImMOBrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:26:22 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:26:22 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:26:22 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d98eb6f-eff0-4f6e-ac99-3dab11c6384b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:26:22 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae4499-ea61-438e-b4d5-a6edd63cf82e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a] added
Nov 14 19:26:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[21173b78-5e40-4f26-8f00-ae925a7febae]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[78439e25-8572-4a9e-a764-9bc82d0f9af7]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vImMOBrF {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vImMOBrF" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80cda29-d7fe-4e06-97dd-9a29bf3a7703]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vImMOBrF'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c895b45b-a4b1-4f3d-ac04-45fde03d27a1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0181a9fe-08b9-41f3-9bcd-013f7d0ee45f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[945ed9ac-d58f-47ef-95a4-8b2ca6429f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260]
Nov 14 19:26:22 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260] successful.
Nov 14 19:26:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3006fad-1918-4ff3-85e9-e199293d3542]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[665d7827-ba90-4a81-986a-f71a5c6a4438]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:26:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:26:22 user nova-compute[75205]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:26:22 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb2747-b46b-4479-b982-5804b418bbac]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vImMOBrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:26:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26665613036323930', 'path': '/dev/sde'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665613036323930', 'path': '/dev/sde'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-120934111',display_name='tempest-ServerActionsTestOtherA-server-120934111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-120934111',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3OJYMfErFiTGe/qVImPNNpMoleZ3J9mAlhBnKRLLztrPxOuSUjWBVerPUHNAmA4WwUUZXCuLX5O2r/5K813hJJaeAm4LX+jg/1ArdxTUJxjig4g1+w8aJwtp9ZiKaoQA==',key_name='tempest-keypair-1933539898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-4ckfg9fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=298a5eb2-6362-40bd-93fa-2cad9b07718a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'pci_devices' on Instance uuid 298a5eb2-6362-40bd-93fa-2cad9b07718a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:26:23 user nova-compute[75205]:   <uuid>298a5eb2-6362-40bd-93fa-2cad9b07718a</uuid>
Nov 14 19:26:23 user nova-compute[75205]:   <name>instance-00000026</name>
Nov 14 19:26:23 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:26:23 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:26:23 user nova-compute[75205]:   <metadata>
Nov 14 19:26:23 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:26:23 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:26:23 user nova-compute[75205]:       <nova:name>tempest-ServerActionsTestOtherA-server-120934111</nova:name>
Nov 14 19:26:23 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:26:22</nova:creationTime>
Nov 14 19:26:23 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:26:23 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:26:23 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:26:23 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:26:23 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:26:23 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:26:23 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:26:23 user nova-compute[75205]:       <nova:owner>
Nov 14 19:26:23 user nova-compute[75205]:         <nova:user uuid="f89ca9b3c52040acbc46581ac5cf55b9">tempest-ServerActionsTestOtherA-410645410-project-member</nova:user>
Nov 14 19:26:23 user nova-compute[75205]:         <nova:project uuid="55021da245654f6392681359d51cbc9d">tempest-ServerActionsTestOtherA-410645410</nova:project>
Nov 14 19:26:23 user nova-compute[75205]:       </nova:owner>
Nov 14 19:26:23 user nova-compute[75205]:       <nova:ports>
Nov 14 19:26:23 user nova-compute[75205]:         <nova:port uuid="b852cc39-4e71-4a5e-bbbd-6dfd30715442">
Nov 14 19:26:23 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 19:26:23 user nova-compute[75205]:         </nova:port>
Nov 14 19:26:23 user nova-compute[75205]:       </nova:ports>
Nov 14 19:26:23 user nova-compute[75205]:     </nova:instance>
Nov 14 19:26:23 user nova-compute[75205]:   </metadata>
Nov 14 19:26:23 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:26:23 user nova-compute[75205]:     <system>
Nov 14 19:26:23 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:26:23 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:26:23 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:26:23 user nova-compute[75205]:       <entry name="serial">298a5eb2-6362-40bd-93fa-2cad9b07718a</entry>
Nov 14 19:26:23 user nova-compute[75205]:       <entry name="uuid">298a5eb2-6362-40bd-93fa-2cad9b07718a</entry>
Nov 14 19:26:23 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:26:23 user nova-compute[75205]:     </system>
Nov 14 19:26:23 user nova-compute[75205]:   </sysinfo>
Nov 14 19:26:23 user nova-compute[75205]:   <os>
Nov 14 19:26:23 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:26:23 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:26:23 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:26:23 user nova-compute[75205]:   </os>
Nov 14 19:26:23 user nova-compute[75205]:   <features>
Nov 14 19:26:23 user nova-compute[75205]:     <acpi/>
Nov 14 19:26:23 user nova-compute[75205]:     <apic/>
Nov 14 19:26:23 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:26:23 user nova-compute[75205]:   </features>
Nov 14 19:26:23 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:26:23 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:26:23 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:26:23 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:26:23 user nova-compute[75205]:   </clock>
Nov 14 19:26:23 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:26:23 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:26:23 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:26:23 user nova-compute[75205]:   </cpu>
Nov 14 19:26:23 user nova-compute[75205]:   <devices>
Nov 14 19:26:23 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:26:23 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:26:23 user nova-compute[75205]:       <source dev="/dev/sde"/>
Nov 14 19:26:23 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:26:23 user nova-compute[75205]:       <serial>788c1a35-e7c1-4da1-b718-549567f2da3a</serial>
Nov 14 19:26:23 user nova-compute[75205]:     </disk>
Nov 14 19:26:23 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:26:23 user nova-compute[75205]:       <mac address="fa:16:3e:68:ac:59"/>
Nov 14 19:26:23 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:26:23 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:26:23 user nova-compute[75205]:       <target dev="tapb852cc39-4e"/>
Nov 14 19:26:23 user nova-compute[75205]:     </interface>
Nov 14 19:26:23 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:26:23 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/298a5eb2-6362-40bd-93fa-2cad9b07718a/console.log" append="off"/>
Nov 14 19:26:23 user nova-compute[75205]:     </serial>
Nov 14 19:26:23 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:26:23 user nova-compute[75205]:     <video>
Nov 14 19:26:23 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:26:23 user nova-compute[75205]:     </video>
Nov 14 19:26:23 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:26:23 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:26:23 user nova-compute[75205]:     </rng>
Nov 14 19:26:23 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:26:23 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:26:23 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:26:23 user nova-compute[75205]:     </memballoon>
Nov 14 19:26:23 user nova-compute[75205]:   </devices>
Nov 14 19:26:23 user nova-compute[75205]: </domain>
Nov 14 19:26:23 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-120934111',display_name='tempest-ServerActionsTestOtherA-server-120934111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-120934111',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3OJYMfErFiTGe/qVImPNNpMoleZ3J9mAlhBnKRLLztrPxOuSUjWBVerPUHNAmA4WwUUZXCuLX5O2r/5K813hJJaeAm4LX+jg/1ArdxTUJxjig4g1+w8aJwtp9ZiKaoQA==',key_name='tempest-keypair-1933539898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-4ckfg9fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=298a5eb2-6362-40bd-93fa-2cad9b07718a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG os_vif [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afdd41c0-a412-5dbe-938a-86dd2c4526e1', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb852cc39-4e, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb852cc39-4e, col_values=(('qos', UUID('32226e23-da3a-42db-9184-d8d67ecd0b8d')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb852cc39-4e, col_values=(('external_ids', {'iface-id': 'b852cc39-4e71-4a5e-bbbd-6dfd30715442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:ac:59', 'vm-uuid': '298a5eb2-6362-40bd-93fa-2cad9b07718a'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:23 user nova-compute[75205]: INFO os_vif [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e')
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:26:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No VIF found with MAC fa:16:3e:68:ac:59, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:26:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-65cb1a8a-4d07-476e-8353-e887ad55e565 req-c4298cc9-318d-403d-9642-e49f9b78a7e8 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-65cb1a8a-4d07-476e-8353-e887ad55e565 req-c4298cc9-318d-403d-9642-e49f9b78a7e8 service nova] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-65cb1a8a-4d07-476e-8353-e887ad55e565 req-c4298cc9-318d-403d-9642-e49f9b78a7e8 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-65cb1a8a-4d07-476e-8353-e887ad55e565 req-c4298cc9-318d-403d-9642-e49f9b78a7e8 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-65cb1a8a-4d07-476e-8353-e887ad55e565 req-c4298cc9-318d-403d-9642-e49f9b78a7e8 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] No waiting events found dispatching network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:26:25 user nova-compute[75205]: WARNING nova.compute.manager [req-65cb1a8a-4d07-476e-8353-e887ad55e565 req-c4298cc9-318d-403d-9642-e49f9b78a7e8 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received unexpected event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 for instance with vm_state building and task_state spawning.
Nov 14 19:26:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-e002b33f-ed67-4bfe-9018-91cd294e9d14 req-5fbac2ed-f939-46a2-a34e-811aa09a47e3 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e002b33f-ed67-4bfe-9018-91cd294e9d14 req-5fbac2ed-f939-46a2-a34e-811aa09a47e3 service nova] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e002b33f-ed67-4bfe-9018-91cd294e9d14 req-5fbac2ed-f939-46a2-a34e-811aa09a47e3 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e002b33f-ed67-4bfe-9018-91cd294e9d14 req-5fbac2ed-f939-46a2-a34e-811aa09a47e3 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-e002b33f-ed67-4bfe-9018-91cd294e9d14 req-5fbac2ed-f939-46a2-a34e-811aa09a47e3 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] No waiting events found dispatching network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:26:27 user nova-compute[75205]: WARNING nova.compute.manager [req-e002b33f-ed67-4bfe-9018-91cd294e9d14 req-5fbac2ed-f939-46a2-a34e-811aa09a47e3 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received unexpected event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 for instance with vm_state building and task_state spawning.
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:26:27 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Instance spawned successfully.
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:26:27 user nova-compute[75205]: INFO nova.compute.manager [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 14 19:26:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:26:27 user nova-compute[75205]: INFO nova.compute.manager [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Took 10.69 seconds to build instance.
Nov 14 19:26:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b1e416ec-134f-42f3-8730-ccd92adb9a66 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.817s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:33 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:26:33 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:26:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:26:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:26:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:26:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:26:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-a44e54ab-d2b9-4ffc-bc1d-d9f561b11f60 req-992fc27b-82cf-4ae9-a517-527860fcb1f8 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-changed-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-a44e54ab-d2b9-4ffc-bc1d-d9f561b11f60 req-992fc27b-82cf-4ae9-a517-527860fcb1f8 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Refreshing instance network info cache due to event network-changed-ee66e456-9848-4460-ad8d-4a5be982c145. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a44e54ab-d2b9-4ffc-bc1d-d9f561b11f60 req-992fc27b-82cf-4ae9-a517-527860fcb1f8 service nova] Acquiring lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a44e54ab-d2b9-4ffc-bc1d-d9f561b11f60 req-992fc27b-82cf-4ae9-a517-527860fcb1f8 service nova] Acquired lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG nova.network.neutron [req-a44e54ab-d2b9-4ffc-bc1d-d9f561b11f60 req-992fc27b-82cf-4ae9-a517-527860fcb1f8 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Refreshing network info cache for port ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG nova.network.neutron [req-a44e54ab-d2b9-4ffc-bc1d-d9f561b11f60 req-992fc27b-82cf-4ae9-a517-527860fcb1f8 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updated VIF entry in instance network info cache for port ee66e456-9848-4460-ad8d-4a5be982c145. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG nova.network.neutron [req-a44e54ab-d2b9-4ffc-bc1d-d9f561b11f60 req-992fc27b-82cf-4ae9-a517-527860fcb1f8 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updating instance_info_cache with network_info: [{"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a44e54ab-d2b9-4ffc-bc1d-d9f561b11f60 req-992fc27b-82cf-4ae9-a517-527860fcb1f8 service nova] Releasing lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:34 user nova-compute[75205]: INFO nova.compute.manager [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Detaching volume 98620305-f4c7-4522-bf70-8502b5b3a8e4
Nov 14 19:26:34 user nova-compute[75205]: INFO nova.virt.block_device [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Attempting to driver detach volume 98620305-f4c7-4522-bf70-8502b5b3a8e4 from mountpoint /dev/vdb
Nov 14 19:26:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Attempting to detach device vdb from instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:26:34 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:26:34 user nova-compute[75205]:   <source dev="/dev/sdg"/>
Nov 14 19:26:34 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:26:34 user nova-compute[75205]:   <serial>98620305-f4c7-4522-bf70-8502b5b3a8e4</serial>
Nov 14 19:26:34 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:26:34 user nova-compute[75205]: </disk>
Nov 14 19:26:34 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:26:34 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Successfully detached device vdb from instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd from the persistent domain config.
Nov 14 19:26:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:26:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:26:34 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:26:34 user nova-compute[75205]:   <source dev="/dev/sdg"/>
Nov 14 19:26:34 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:26:34 user nova-compute[75205]:   <serial>98620305-f4c7-4522-bf70-8502b5b3a8e4</serial>
Nov 14 19:26:34 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:26:34 user nova-compute[75205]: </disk>
Nov 14 19:26:34 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:26:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:26:35 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG nova.compute.manager [req-2c58d04a-a156-490e-80bd-3869453df48a req-b46798c6-341a-4ec9-9f58-d6b82beaacbd service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-changed-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG nova.compute.manager [req-2c58d04a-a156-490e-80bd-3869453df48a req-b46798c6-341a-4ec9-9f58-d6b82beaacbd service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Refreshing instance network info cache due to event network-changed-ee66e456-9848-4460-ad8d-4a5be982c145. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2c58d04a-a156-490e-80bd-3869453df48a req-b46798c6-341a-4ec9-9f58-d6b82beaacbd service nova] Acquiring lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2c58d04a-a156-490e-80bd-3869453df48a req-b46798c6-341a-4ec9-9f58-d6b82beaacbd service nova] Acquired lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG nova.network.neutron [req-2c58d04a-a156-490e-80bd-3869453df48a req-b46798c6-341a-4ec9-9f58-d6b82beaacbd service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Refreshing network info cache for port ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG nova.network.neutron [req-2c58d04a-a156-490e-80bd-3869453df48a req-b46798c6-341a-4ec9-9f58-d6b82beaacbd service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updated VIF entry in instance network info cache for port ee66e456-9848-4460-ad8d-4a5be982c145. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG nova.network.neutron [req-2c58d04a-a156-490e-80bd-3869453df48a req-b46798c6-341a-4ec9-9f58-d6b82beaacbd service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updating instance_info_cache with network_info: [{"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:26:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2c58d04a-a156-490e-80bd-3869453df48a req-b46798c6-341a-4ec9-9f58-d6b82beaacbd service nova] Releasing lock "refresh_cache-3ff88760-fa4a-4e52-a23e-6c60f54394cd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:39 user nova-compute[75205]: INFO nova.compute.manager [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Terminating instance
Nov 14 19:26:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-dfae05ad-5185-4e87-8048-cfd6bc2e6b3b req-e4f8d132-a000-4be1-85fd-e092db858e2c service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Received event network-vif-unplugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dfae05ad-5185-4e87-8048-cfd6bc2e6b3b req-e4f8d132-a000-4be1-85fd-e092db858e2c service nova] Acquiring lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dfae05ad-5185-4e87-8048-cfd6bc2e6b3b req-e4f8d132-a000-4be1-85fd-e092db858e2c service nova] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dfae05ad-5185-4e87-8048-cfd6bc2e6b3b req-e4f8d132-a000-4be1-85fd-e092db858e2c service nova] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-dfae05ad-5185-4e87-8048-cfd6bc2e6b3b req-e4f8d132-a000-4be1-85fd-e092db858e2c service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] No waiting events found dispatching network-vif-unplugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-dfae05ad-5185-4e87-8048-cfd6bc2e6b3b req-e4f8d132-a000-4be1-85fd-e092db858e2c service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Received event network-vif-unplugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Instance destroyed successfully.
Nov 14 19:26:39 user nova-compute[75205]: DEBUG nova.objects.instance [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lazy-loading 'resources' on Instance uuid e59c991e-1921-4e71-8680-b8ceb4f3ccf2 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1665402174',display_name='tempest-ServersNegativeTestJSON-server-1665402174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1665402174',id=36,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:24:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80601810103b45acaf3c28a876fb51d8',ramdisk_id='',reservation_id='r-asrbfx0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-405327324',owner_user_name='tempest-ServersNegativeTestJSON-405327324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:24:55Z,user_data=None,user_id='406f12b163cb4a989209213026aae994',uuid=e59c991e-1921-4e71-8680-b8ceb4f3ccf2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "address": "fa:16:3e:69:c6:51", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a242ef-40", "ovs_interfaceid": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converting VIF {"id": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "address": "fa:16:3e:69:c6:51", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a242ef-40", "ovs_interfaceid": "80a242ef-40ae-4609-b6bb-dc5c169c7f0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c6:51,bridge_name='br-int',has_traffic_filtering=True,id=80a242ef-40ae-4609-b6bb-dc5c169c7f0c,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a242ef-40') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG os_vif [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c6:51,bridge_name='br-int',has_traffic_filtering=True,id=80a242ef-40ae-4609-b6bb-dc5c169c7f0c,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a242ef-40') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80a242ef-40, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d62c1cb-ef04-4a71-8a48-7ff411972705) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:40 user nova-compute[75205]: INFO os_vif [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c6:51,bridge_name='br-int',has_traffic_filtering=True,id=80a242ef-40ae-4609-b6bb-dc5c169c7f0c,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a242ef-40')
Nov 14 19:26:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Deleting instance files /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2_del
Nov 14 19:26:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Deletion of /opt/stack/data/nova/instances/e59c991e-1921-4e71-8680-b8ceb4f3ccf2_del complete
Nov 14 19:26:40 user nova-compute[75205]: INFO nova.compute.manager [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 19:26:40 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:26:40 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:26:40 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:26:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-00255be6-0cda-4965-b3ca-cc0fef519de7 req-3fd43ec0-f366-4e7d-8e55-311b6b639f3d service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Received event network-vif-deleted-80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:40 user nova-compute[75205]: INFO nova.compute.manager [req-00255be6-0cda-4965-b3ca-cc0fef519de7 req-3fd43ec0-f366-4e7d-8e55-311b6b639f3d service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Neutron deleted interface 80a242ef-40ae-4609-b6bb-dc5c169c7f0c; detaching it from the instance and deleting it from the info cache
Nov 14 19:26:40 user nova-compute[75205]: DEBUG nova.network.neutron [req-00255be6-0cda-4965-b3ca-cc0fef519de7 req-3fd43ec0-f366-4e7d-8e55-311b6b639f3d service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:26:40 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:26:40 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:26:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7707MB free_disk=24.974044799804688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:26:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:40 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:26:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-00255be6-0cda-4965-b3ca-cc0fef519de7 req-3fd43ec0-f366-4e7d-8e55-311b6b639f3d service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Detach interface failed, port_id=80a242ef-40ae-4609-b6bb-dc5c169c7f0c, reason: Instance e59c991e-1921-4e71-8680-b8ceb4f3ccf2 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:26:40 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Took 0.82 seconds to deallocate network for instance.
Nov 14 19:26:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d453ca1b-600f-40a9-9478-60ae619302ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7260ad81-fc37-4726-8fee-9adecb58040f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance e59c991e-1921-4e71-8680-b8ceb4f3ccf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance a61f9690-6f49-4ba0-8258-599e4e5cc917 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 298a5eb2-6362-40bd-93fa-2cad9b07718a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.458s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-8b003e44-b797-4e7e-97b2-f3f4d5e90430 req-7d061dd5-9637-4dfb-ade0-c1380a051c3f service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Received event network-vif-plugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8b003e44-b797-4e7e-97b2-f3f4d5e90430 req-7d061dd5-9637-4dfb-ade0-c1380a051c3f service nova] Acquiring lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8b003e44-b797-4e7e-97b2-f3f4d5e90430 req-7d061dd5-9637-4dfb-ade0-c1380a051c3f service nova] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8b003e44-b797-4e7e-97b2-f3f4d5e90430 req-7d061dd5-9637-4dfb-ade0-c1380a051c3f service nova] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-8b003e44-b797-4e7e-97b2-f3f4d5e90430 req-7d061dd5-9637-4dfb-ade0-c1380a051c3f service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] No waiting events found dispatching network-vif-plugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:26:41 user nova-compute[75205]: WARNING nova.compute.manager [req-8b003e44-b797-4e7e-97b2-f3f4d5e90430 req-7d061dd5-9637-4dfb-ade0-c1380a051c3f service nova] [instance: e59c991e-1921-4e71-8680-b8ceb4f3ccf2] Received unexpected event network-vif-plugged-80a242ef-40ae-4609-b6bb-dc5c169c7f0c for instance with vm_state deleted and task_state None.
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:26:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:41 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Deleted allocations for instance e59c991e-1921-4e71-8680-b8ceb4f3ccf2
Nov 14 19:26:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-9590fa36-bf84-486c-b421-f531aee42307 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "e59c991e-1921-4e71-8680-b8ceb4f3ccf2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.766s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Updating instance_info_cache with network_info: [{"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-7803fcca-eed8-4088-b1dc-e0908dcecaa4" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:26:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:26:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:26:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:47 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:26:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:55 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd is timed out.
Nov 14 19:26:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Successfully detached device vdb from instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd from the live domain config.
Nov 14 19:26:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLUJiuhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:26:55 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f33bd11-b9d7-42c8-818f-7b8b98becf4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:26:55 user nova-compute[75205]: No targets found.
Nov 14 19:26:55 user nova-compute[75205]: iSNS:
Nov 14 19:26:55 user nova-compute[75205]: No targets found.
Nov 14 19:26:55 user nova-compute[75205]: STATIC:
Nov 14 19:26:55 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a
Nov 14 19:26:55 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:26:55 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:26:55 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8
Nov 14 19:26:55 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:26:55 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:26:55 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:26:55 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:26:55 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:26:55 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4
Nov 14 19:26:55 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:26:55 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:26:55 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c
Nov 14 19:26:55 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:26:55 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:26:55 user nova-compute[75205]: FIRMWARE:
Nov 14 19:26:55 user nova-compute[75205]: No targets found.
Nov 14 19:26:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:26:55 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:26:55 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca173589-bd29-4dcf-a7d6-5d0f73b6fe9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbf3d42-4240-437a-b22e-9065e758ad2b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:26:55 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:26:55 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:26:55 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:26:55 user nova-compute[75205]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:26:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:26:55 user nova-compute[75205]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 (non-flash)
Nov 14 19:26:55 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:26:55 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:26:55 user nova-compute[75205]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:26:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7412c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4'): ({'sdg'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Removing single pathed devices sdg {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[96823d9f-07ec-4c0b-9799-30c63096bdb3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[667f9dc7-d3a0-42c2-bf02-97ad69862510]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Flushing IO for device /dev/sdg {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[265723c4-1e14-4e34-94c0-261e47e2861c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30bc19c-6fc4-42c8-bebf-19420d79c454]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] SCSI volumes sdg have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc07616e-f64c-4102-9c50-155f81d06ae5]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb232833-b54a-46af-ada3-4778f4f8720f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4, portal: 172.16.0.220,3260]
Nov 14 19:26:55 user nova-compute[75205]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4, portal: 172.16.0.220,3260] successful.
Nov 14 19:26:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98620305-f4c7-4522-bf70-8502b5b3a8e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c828d1db-fb90-48da-b69c-3ea89dcde106]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] <== disconnect_volume: return (331ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:26:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:26:56 user nova-compute[75205]: DEBUG nova.objects.instance [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'flavor' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:26:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1b0a54f4-ae77-4c99-ab92-707af17e7a80 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.707s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:26:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:26:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG nova.compute.manager [req-7e8f9425-ca1f-4545-adbd-88cdf547c89e req-f81a9c51-4157-4a0e-8c86-b9fd21f9b2d1 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received event network-changed-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG nova.compute.manager [req-7e8f9425-ca1f-4545-adbd-88cdf547c89e req-f81a9c51-4157-4a0e-8c86-b9fd21f9b2d1 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Refreshing instance network info cache due to event network-changed-eea2ded2-5c0b-42b6-aead-a65f7cc324bc. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7e8f9425-ca1f-4545-adbd-88cdf547c89e req-f81a9c51-4157-4a0e-8c86-b9fd21f9b2d1 service nova] Acquiring lock "refresh_cache-a61f9690-6f49-4ba0-8258-599e4e5cc917" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7e8f9425-ca1f-4545-adbd-88cdf547c89e req-f81a9c51-4157-4a0e-8c86-b9fd21f9b2d1 service nova] Acquired lock "refresh_cache-a61f9690-6f49-4ba0-8258-599e4e5cc917" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG nova.network.neutron [req-7e8f9425-ca1f-4545-adbd-88cdf547c89e req-f81a9c51-4157-4a0e-8c86-b9fd21f9b2d1 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Refreshing network info cache for port eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG nova.network.neutron [req-7e8f9425-ca1f-4545-adbd-88cdf547c89e req-f81a9c51-4157-4a0e-8c86-b9fd21f9b2d1 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Updated VIF entry in instance network info cache for port eea2ded2-5c0b-42b6-aead-a65f7cc324bc. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG nova.network.neutron [req-7e8f9425-ca1f-4545-adbd-88cdf547c89e req-f81a9c51-4157-4a0e-8c86-b9fd21f9b2d1 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Updating instance_info_cache with network_info: [{"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7e8f9425-ca1f-4545-adbd-88cdf547c89e req-f81a9c51-4157-4a0e-8c86-b9fd21f9b2d1 service nova] Releasing lock "refresh_cache-a61f9690-6f49-4ba0-8258-599e4e5cc917" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "a61f9690-6f49-4ba0-8258-599e4e5cc917" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:01 user nova-compute[75205]: INFO nova.compute.manager [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Terminating instance
Nov 14 19:27:01 user nova-compute[75205]: DEBUG nova.compute.manager [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-ccbf7750-ecc9-48bf-9c79-871fcb0b2dc8 req-515e07b7-6e07-49ab-9ecc-cebf4b858d8f service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received event network-vif-unplugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ccbf7750-ecc9-48bf-9c79-871fcb0b2dc8 req-515e07b7-6e07-49ab-9ecc-cebf4b858d8f service nova] Acquiring lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ccbf7750-ecc9-48bf-9c79-871fcb0b2dc8 req-515e07b7-6e07-49ab-9ecc-cebf4b858d8f service nova] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ccbf7750-ecc9-48bf-9c79-871fcb0b2dc8 req-515e07b7-6e07-49ab-9ecc-cebf4b858d8f service nova] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-ccbf7750-ecc9-48bf-9c79-871fcb0b2dc8 req-515e07b7-6e07-49ab-9ecc-cebf4b858d8f service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] No waiting events found dispatching network-vif-unplugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-ccbf7750-ecc9-48bf-9c79-871fcb0b2dc8 req-515e07b7-6e07-49ab-9ecc-cebf4b858d8f service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received event network-vif-unplugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:27:02 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Instance destroyed successfully.
Nov 14 19:27:02 user nova-compute[75205]: DEBUG nova.objects.instance [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'resources' on Instance uuid a61f9690-6f49-4ba0-8258-599e4e5cc917 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-668820460',display_name='tempest-TestVolumeBootPattern-server-668820460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-668820460',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4lflwSUeyVbH81QiQ0Uh3cKzramHeRM7aduqUtZ4pb3+SjiUT5tItPthN7NGlihkCZ2OzXolgwmiBolVRT+jaN4ru1XGIc7ZtqCPOyOWGe8i2eYeT/Jps/FMv13SMF/w==',key_name='tempest-TestVolumeBootPattern-186737572',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:25:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-to41uxu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:25:19Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=a61f9690-6f49-4ba0-8258-599e4e5cc917,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "address": "fa:16:3e:bb:04:84", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea2ded2-5c", "ovs_interfaceid": "eea2ded2-5c0b-42b6-aead-a65f7cc324bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=eea2ded2-5c0b-42b6-aead-a65f7cc324bc,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea2ded2-5c') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_vif [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=eea2ded2-5c0b-42b6-aead-a65f7cc324bc,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea2ded2-5c') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeea2ded2-5c, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a51a2bea-9f9b-4373-92d5-3e5063e48e51) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:02 user nova-compute[75205]: INFO os_vif [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=eea2ded2-5c0b-42b6-aead-a65f7cc324bc,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea2ded2-5c')
Nov 14 19:27:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EiByouVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:27:02 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e216b6-d3b3-4752-af90-1d53ceb05e00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:27:02 user nova-compute[75205]: No targets found.
Nov 14 19:27:02 user nova-compute[75205]: iSNS:
Nov 14 19:27:02 user nova-compute[75205]: No targets found.
Nov 14 19:27:02 user nova-compute[75205]: STATIC:
Nov 14 19:27:02 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a
Nov 14 19:27:02 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:27:02 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:27:02 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8
Nov 14 19:27:02 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:27:02 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:27:02 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:27:02 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:27:02 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:27:02 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c
Nov 14 19:27:02 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:27:02 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:27:02 user nova-compute[75205]: FIRMWARE:
Nov 14 19:27:02 user nova-compute[75205]: No targets found.
Nov 14 19:27:02 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:27:02 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:27:02 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[11532d47-eed1-4247-82c1-ea55ca4b1b29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcea7bd-417d-443b-8452-b41f13f74b60]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:27:02 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:27:02 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:27:02 user nova-compute[75205]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:27:02 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:27:02 user nova-compute[75205]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:27:02 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:27:02 user nova-compute[75205]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:27:02 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb94bdc1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0689f9ff-2120-48d6-ab81-bbcf43fa5a8b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97b2fc8-463e-4e1f-b432-748c4348ffb0]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[48490154-70d8-42ca-b115-0a13f31b3897]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:27:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.126s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[329ba628-bbff-406f-a259-f32e84d8e6af]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ae99a7-c5d8-4c8c-845b-7eec69a551a4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[29773aba-e18c-4bb3-af39-a3395424fe2d]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260]
Nov 14 19:27:03 user nova-compute[75205]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260] successful.
Nov 14 19:27:03 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4159554-17aa-43b5-b30e-4132de963e50]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== disconnect_volume: return (381ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:27:03 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Deleting instance files /opt/stack/data/nova/instances/a61f9690-6f49-4ba0-8258-599e4e5cc917_del
Nov 14 19:27:03 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Deletion of /opt/stack/data/nova/instances/a61f9690-6f49-4ba0-8258-599e4e5cc917_del complete
Nov 14 19:27:03 user nova-compute[75205]: INFO nova.compute.manager [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 14 19:27:03 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:27:03 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:03 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Took 0.79 seconds to deallocate network for instance.
Nov 14 19:27:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-eb6764ef-5d20-4cd6-9fd5-04f58c4279ef req-c0021b2c-a172-4dc1-ae69-87c4af75d001 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received event network-vif-deleted-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-6f63f7af-7d00-4f3d-84ff-dc2d87624f33 req-85e91328-6f33-4eae-b5cf-d1c1ff0c2937 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received event network-vif-plugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6f63f7af-7d00-4f3d-84ff-dc2d87624f33 req-85e91328-6f33-4eae-b5cf-d1c1ff0c2937 service nova] Acquiring lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6f63f7af-7d00-4f3d-84ff-dc2d87624f33 req-85e91328-6f33-4eae-b5cf-d1c1ff0c2937 service nova] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6f63f7af-7d00-4f3d-84ff-dc2d87624f33 req-85e91328-6f33-4eae-b5cf-d1c1ff0c2937 service nova] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-6f63f7af-7d00-4f3d-84ff-dc2d87624f33 req-85e91328-6f33-4eae-b5cf-d1c1ff0c2937 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] No waiting events found dispatching network-vif-plugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:27:04 user nova-compute[75205]: WARNING nova.compute.manager [req-6f63f7af-7d00-4f3d-84ff-dc2d87624f33 req-85e91328-6f33-4eae-b5cf-d1c1ff0c2937 service nova] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Received unexpected event network-vif-plugged-eea2ded2-5c0b-42b6-aead-a65f7cc324bc for instance with vm_state active and task_state deleting.
Nov 14 19:27:04 user nova-compute[75205]: INFO nova.compute.manager [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: a61f9690-6f49-4ba0-8258-599e4e5cc917] Took 0.85 seconds to detach 1 volumes for instance.
Nov 14 19:27:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:05 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:27:05 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:27:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:05 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Deleted allocations for instance a61f9690-6f49-4ba0-8258-599e4e5cc917
Nov 14 19:27:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-055fa779-015e-4426-b0f1-5f5744278a26 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "a61f9690-6f49-4ba0-8258-599e4e5cc917" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.376s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:05 user nova-compute[75205]: INFO nova.compute.manager [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Detaching volume edc77529-7a26-43d4-873a-d6fe5adb93a8
Nov 14 19:27:05 user nova-compute[75205]: INFO nova.virt.block_device [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Attempting to driver detach volume edc77529-7a26-43d4-873a-d6fe5adb93a8 from mountpoint /dev/vdc
Nov 14 19:27:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Attempting to detach device vdc from instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:27:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:27:05 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:27:05 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:27:05 user nova-compute[75205]:   <target dev="vdc" bus="virtio"/>
Nov 14 19:27:05 user nova-compute[75205]:   <serial>edc77529-7a26-43d4-873a-d6fe5adb93a8</serial>
Nov 14 19:27:05 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 19:27:05 user nova-compute[75205]: </disk>
Nov 14 19:27:05 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:27:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Successfully detached device vdc from instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 from the persistent domain config.
Nov 14 19:27:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:27:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:27:05 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:27:05 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:27:05 user nova-compute[75205]:   <target dev="vdc" bus="virtio"/>
Nov 14 19:27:05 user nova-compute[75205]:   <serial>edc77529-7a26-43d4-873a-d6fe5adb93a8</serial>
Nov 14 19:27:05 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 19:27:05 user nova-compute[75205]: </disk>
Nov 14 19:27:05 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:27:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:27:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "d453ca1b-600f-40a9-9478-60ae619302ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:07 user nova-compute[75205]: INFO nova.compute.manager [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Terminating instance
Nov 14 19:27:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:27:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-f803c75e-eae5-4945-88c9-f19f636eb7f8 req-deaf411a-ee97-41b1-a39a-861b63fb0125 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-unplugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f803c75e-eae5-4945-88c9-f19f636eb7f8 req-deaf411a-ee97-41b1-a39a-861b63fb0125 service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f803c75e-eae5-4945-88c9-f19f636eb7f8 req-deaf411a-ee97-41b1-a39a-861b63fb0125 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f803c75e-eae5-4945-88c9-f19f636eb7f8 req-deaf411a-ee97-41b1-a39a-861b63fb0125 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-f803c75e-eae5-4945-88c9-f19f636eb7f8 req-deaf411a-ee97-41b1-a39a-861b63fb0125 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-unplugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-f803c75e-eae5-4945-88c9-f19f636eb7f8 req-deaf411a-ee97-41b1-a39a-861b63fb0125 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-unplugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:27:08 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Instance destroyed successfully.
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.objects.instance [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'resources' on Instance uuid d453ca1b-600f-40a9-9478-60ae619302ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2107882720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2107882720',id=13,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:13:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-nnfvmpga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:15:07Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=d453ca1b-600f-40a9-9478-60ae619302ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "address": "fa:16:3e:02:4e:6d", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1d6240-9d", "ovs_interfaceid": "5e1d6240-9d0b-4c83-9674-16d633e92bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:4e:6d,bridge_name='br-int',has_traffic_filtering=True,id=5e1d6240-9d0b-4c83-9674-16d633e92bde,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1d6240-9d') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_vif [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:4e:6d,bridge_name='br-int',has_traffic_filtering=True,id=5e1d6240-9d0b-4c83-9674-16d633e92bde,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1d6240-9d') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e1d6240-9d, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d24d795-a00e-4da4-80ae-50c8278f5f1e) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:08 user nova-compute[75205]: INFO os_vif [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:4e:6d,bridge_name='br-int',has_traffic_filtering=True,id=5e1d6240-9d0b-4c83-9674-16d633e92bde,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1d6240-9d')
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELZUBViw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:27:08 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b6cebc-47a8-4a80-93fd-a48d1c57cd8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:27:08 user nova-compute[75205]: No targets found.
Nov 14 19:27:08 user nova-compute[75205]: iSNS:
Nov 14 19:27:08 user nova-compute[75205]: No targets found.
Nov 14 19:27:08 user nova-compute[75205]: STATIC:
Nov 14 19:27:08 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a
Nov 14 19:27:08 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:27:08 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:27:08 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8
Nov 14 19:27:08 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:27:08 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:27:08 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844
Nov 14 19:27:08 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:27:08 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:27:08 user nova-compute[75205]: FIRMWARE:
Nov 14 19:27:08 user nova-compute[75205]: No targets found.
Nov 14 19:27:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:27:08 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:27:08 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfa91cd-b07a-4c05-a2b2-f9dd2781df71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae9bc06-49ca-4c44-8567-38c80400dc00]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:27:08 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:27:08 user nova-compute[75205]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:27:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 (non-flash)
Nov 14 19:27:08 user nova-compute[75205]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:27:08 user nova-compute[75205]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:27:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb94d3bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[15888a07-c455-4d2b-a6c4-dbae707db975]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9807cf23-f690-49ca-b872-03f1580fa240]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c28228-51e8-4d3c-a46b-bbc4db5b7dc1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f1e182-364d-4bd5-836c-9fd74bbd4d39]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bfa317-1e93-45d5-a32a-5b4d2e3e1041]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62030aa-1531-4369-9355-2aaabe19790f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844, portal: 172.16.0.220,3260]
Nov 14 19:27:08 user nova-compute[75205]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844, portal: 172.16.0.220,3260] successful.
Nov 14 19:27:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d62c2b92-9d2a-4d53-a265-ff059dab8844 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bd03d3-294e-4b13-bc8e-6b6e999861a4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] <== disconnect_volume: return (292ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:27:08 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Deleting instance files /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca_del
Nov 14 19:27:08 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Deletion of /opt/stack/data/nova/instances/d453ca1b-600f-40a9-9478-60ae619302ca_del complete
Nov 14 19:27:08 user nova-compute[75205]: INFO nova.compute.manager [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 19:27:08 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:27:08 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:27:09 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:09 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Took 0.44 seconds to deallocate network for instance.
Nov 14 19:27:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-14f802f9-ce45-4dd2-a48c-7deaf3170345 req-ed383135-c80c-459a-b579-05f8a399bddf service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-deleted-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:09 user nova-compute[75205]: INFO nova.compute.manager [req-14f802f9-ce45-4dd2-a48c-7deaf3170345 req-ed383135-c80c-459a-b579-05f8a399bddf service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Neutron deleted interface 5e1d6240-9d0b-4c83-9674-16d633e92bde; detaching it from the instance and deleting it from the info cache
Nov 14 19:27:09 user nova-compute[75205]: DEBUG nova.network.neutron [req-14f802f9-ce45-4dd2-a48c-7deaf3170345 req-ed383135-c80c-459a-b579-05f8a399bddf service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-14f802f9-ce45-4dd2-a48c-7deaf3170345 req-ed383135-c80c-459a-b579-05f8a399bddf service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Detach interface failed, port_id=5e1d6240-9d0b-4c83-9674-16d633e92bde, reason: Instance d453ca1b-600f-40a9-9478-60ae619302ca could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:27:10 user nova-compute[75205]: INFO nova.compute.manager [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 19:27:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-c99200dd-a66d-4d79-bb6a-a1a4155f4091 req-95e70546-ec09-478a-a0f1-7933133bd3a4 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c99200dd-a66d-4d79-bb6a-a1a4155f4091 req-95e70546-ec09-478a-a0f1-7933133bd3a4 service nova] Acquiring lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c99200dd-a66d-4d79-bb6a-a1a4155f4091 req-95e70546-ec09-478a-a0f1-7933133bd3a4 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c99200dd-a66d-4d79-bb6a-a1a4155f4091 req-95e70546-ec09-478a-a0f1-7933133bd3a4 service nova] Lock "d453ca1b-600f-40a9-9478-60ae619302ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-c99200dd-a66d-4d79-bb6a-a1a4155f4091 req-95e70546-ec09-478a-a0f1-7933133bd3a4 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] No waiting events found dispatching network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:27:10 user nova-compute[75205]: WARNING nova.compute.manager [req-c99200dd-a66d-4d79-bb6a-a1a4155f4091 req-95e70546-ec09-478a-a0f1-7933133bd3a4 service nova] [instance: d453ca1b-600f-40a9-9478-60ae619302ca] Received unexpected event network-vif-plugged-5e1d6240-9d0b-4c83-9674-16d633e92bde for instance with vm_state deleted and task_state None.
Nov 14 19:27:10 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:27:10 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:27:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:10 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Deleted allocations for instance d453ca1b-600f-40a9-9478-60ae619302ca
Nov 14 19:27:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-537756bb-89fc-478d-ada5-62d73efcd9d6 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "d453ca1b-600f-40a9-9478-60ae619302ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.740s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:27:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:27:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:27:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:27:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:25 user nova-compute[75205]: INFO nova.compute.manager [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Terminating instance
Nov 14 19:27:25 user nova-compute[75205]: DEBUG nova.compute.manager [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-06b492ff-793c-4e23-9eda-cbe7c2d15f09 req-ed44e3b2-7bb8-4994-9c42-6616b2a5971e service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-unplugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-06b492ff-793c-4e23-9eda-cbe7c2d15f09 req-ed44e3b2-7bb8-4994-9c42-6616b2a5971e service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-06b492ff-793c-4e23-9eda-cbe7c2d15f09 req-ed44e3b2-7bb8-4994-9c42-6616b2a5971e service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-06b492ff-793c-4e23-9eda-cbe7c2d15f09 req-ed44e3b2-7bb8-4994-9c42-6616b2a5971e service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-06b492ff-793c-4e23-9eda-cbe7c2d15f09 req-ed44e3b2-7bb8-4994-9c42-6616b2a5971e service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-unplugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-06b492ff-793c-4e23-9eda-cbe7c2d15f09 req-ed44e3b2-7bb8-4994-9c42-6616b2a5971e service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-unplugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Instance destroyed successfully.
Nov 14 19:27:25 user nova-compute[75205]: DEBUG nova.objects.instance [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'resources' on Instance uuid 3ff88760-fa4a-4e52-a23e-6c60f54394cd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1382296437',display_name='tempest-ServerRescueNegativeTestJSON-server-1382296437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1382296437',id=32,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx4U+t4jtcgjmgFSJ+v+lTnWYR1BloB+eFgId25+qWaPBz41M/IStX7CJqL/vVNvD/TTJe7ZN6ebYa12QO6g9be/g1oyxCRNR9IfGtvmBsLdSzXlSfhLhDcm/EPZ0vNlw==',key_name='tempest-keypair-729185892',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-2t2akl9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:24:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b03af1014734b1a8d4c2633756070e8',uuid=3ff88760-fa4a-4e52-a23e-6c60f54394cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "ee66e456-9848-4460-ad8d-4a5be982c145", "address": "fa:16:3e:a3:31:45", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee66e456-98", "ovs_interfaceid": "ee66e456-9848-4460-ad8d-4a5be982c145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:31:45,bridge_name='br-int',has_traffic_filtering=True,id=ee66e456-9848-4460-ad8d-4a5be982c145,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee66e456-98') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG os_vif [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:31:45,bridge_name='br-int',has_traffic_filtering=True,id=ee66e456-9848-4460-ad8d-4a5be982c145,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee66e456-98') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee66e456-98, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a851c24-98e1-407d-bf84-590e822f160e) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:25 user nova-compute[75205]: INFO os_vif [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:31:45,bridge_name='br-int',has_traffic_filtering=True,id=ee66e456-9848-4460-ad8d-4a5be982c145,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee66e456-98')
Nov 14 19:27:25 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Deleting instance files /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd_del
Nov 14 19:27:25 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Deletion of /opt/stack/data/nova/instances/3ff88760-fa4a-4e52-a23e-6c60f54394cd_del complete
Nov 14 19:27:26 user nova-compute[75205]: INFO nova.compute.manager [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:27:26 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 is timed out.
Nov 14 19:27:26 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Successfully detached device vdc from instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 from the live domain config.
Nov 14 19:27:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRdEKCrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:27:26 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1e03c0-8ea8-4faf-ba3a-0026a335e79a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:27:26 user nova-compute[75205]: No targets found.
Nov 14 19:27:26 user nova-compute[75205]: iSNS:
Nov 14 19:27:26 user nova-compute[75205]: No targets found.
Nov 14 19:27:26 user nova-compute[75205]: STATIC:
Nov 14 19:27:26 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a
Nov 14 19:27:26 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:27:26 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:27:26 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8
Nov 14 19:27:26 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:27:26 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:27:26 user nova-compute[75205]: FIRMWARE:
Nov 14 19:27:26 user nova-compute[75205]: No targets found.
Nov 14 19:27:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:27:26 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:27:26 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5486ad-79bd-438c-b970-eee3b0c386e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5929a06-7bd0-4d91-b3fd-151c2dc07b73]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:27:26 user nova-compute[75205]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:27:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 (non-flash)
Nov 14 19:27:26 user nova-compute[75205]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:27:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7412f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8'): ({'sdd'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Removing single pathed devices sdd {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[588bc688-ab0c-4a0a-b029-9bbbf6c40a3b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f328c9e-b209-4e69-95be-1dacbad7ebf8]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Flushing IO for device /dev/sdd {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b518ae3b-7498-4a85-9088-a2bc2a4d994a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d614dde3-3805-40cf-9649-b88622b14fbf]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4acdfeb-2bc9-4b87-ae6d-92f835544ab3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae8cd7f-1655-46ab-854b-b0bf23dc2e53]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8, portal: 172.16.0.220,3260]
Nov 14 19:27:26 user nova-compute[75205]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8, portal: 172.16.0.220,3260] successful.
Nov 14 19:27:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc77529-7a26-43d4-873a-d6fe5adb93a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8866d2d7-b405-4388-ba6f-7a16fae1716c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] <== disconnect_volume: return (298ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:26 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Took 0.77 seconds to deallocate network for instance.
Nov 14 19:27:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-1518dfee-6e4c-4b3c-9a2c-7ed7302aa248 req-c07c1f4b-5b68-452f-ac61-69664abedc82 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-deleted-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:26 user nova-compute[75205]: INFO nova.compute.manager [req-1518dfee-6e4c-4b3c-9a2c-7ed7302aa248 req-c07c1f4b-5b68-452f-ac61-69664abedc82 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Neutron deleted interface ee66e456-9848-4460-ad8d-4a5be982c145; detaching it from the instance and deleting it from the info cache
Nov 14 19:27:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-1518dfee-6e4c-4b3c-9a2c-7ed7302aa248 req-c07c1f4b-5b68-452f-ac61-69664abedc82 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-1518dfee-6e4c-4b3c-9a2c-7ed7302aa248 req-c07c1f4b-5b68-452f-ac61-69664abedc82 service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Detach interface failed, port_id=ee66e456-9848-4460-ad8d-4a5be982c145, reason: Instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:27 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:27:27 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:27:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:27 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Deleted allocations for instance 3ff88760-fa4a-4e52-a23e-6c60f54394cd
Nov 14 19:27:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-6b0aee47-07f6-46e9-8b25-1cedee3c4021 tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.074s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:27 user nova-compute[75205]: DEBUG nova.objects.instance [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'flavor' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:27:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-647cafc7-7b7e-4a9d-8769-7597da4559a8 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.671s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-4c12931d-79bc-418f-9fa5-2e915de801df req-1c9a48e6-56e7-4b2c-a79e-453507d8a33d service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4c12931d-79bc-418f-9fa5-2e915de801df req-1c9a48e6-56e7-4b2c-a79e-453507d8a33d service nova] Acquiring lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4c12931d-79bc-418f-9fa5-2e915de801df req-1c9a48e6-56e7-4b2c-a79e-453507d8a33d service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4c12931d-79bc-418f-9fa5-2e915de801df req-1c9a48e6-56e7-4b2c-a79e-453507d8a33d service nova] Lock "3ff88760-fa4a-4e52-a23e-6c60f54394cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-4c12931d-79bc-418f-9fa5-2e915de801df req-1c9a48e6-56e7-4b2c-a79e-453507d8a33d service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] No waiting events found dispatching network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:27:27 user nova-compute[75205]: WARNING nova.compute.manager [req-4c12931d-79bc-418f-9fa5-2e915de801df req-1c9a48e6-56e7-4b2c-a79e-453507d8a33d service nova] [instance: 3ff88760-fa4a-4e52-a23e-6c60f54394cd] Received unexpected event network-vif-plugged-ee66e456-9848-4460-ad8d-4a5be982c145 for instance with vm_state deleted and task_state None.
Nov 14 19:27:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:33 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:27:33 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:27:35 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:27:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:36 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:27:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:36 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:27:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:27:39 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:27:39 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8080MB free_disk=25.028358459472656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e3657fa-d795-4732-852a-158c68452387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7260ad81-fc37-4726-8fee-9adecb58040f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 298a5eb2-6362-40bd-93fa-2cad9b07718a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:27:39 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:27:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:27:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updating instance_info_cache with network_info: [{"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:27:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:27:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:27:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:27:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:27:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:53 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:27:53 user nova-compute[75205]: INFO nova.compute.claims [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Claim successful on node user
Nov 14 19:27:54 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:27:54 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:27:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG nova.policy [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06b3b7a0f2ae441f8cb1d50891fcab94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fe039dc34949509e4ad72cd9da3bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:27:54 user nova-compute[75205]: INFO nova.virt.block_device [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Booting with volume 5384e6fc-7619-469f-8b8d-0a8cfdaa350c at /dev/vda
Nov 14 19:27:54 user nova-compute[75205]: DEBUG os_brick.utils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e6d282-8cb3-4866-8239-c0eb8b8d7511]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3f0b84-f792-4ab3-9e3f-acaed1a61c01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc96aa-620a-41d4-ba11-8c73b11ae487]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dac1506-398e-424a-8acb-09e6b0bd3b63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:27:54 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:27:54 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dca7cd-826b-41e1-adf5-d03ab156a763]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG os_brick.utils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:27:54 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Updating existing volume attachment record: 235551db-b6c7-422c-b6bf-39b75f28eac8 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Successfully created port: 85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Successfully updated port: 85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquired lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-5fd82b05-e172-4711-9eb5-d492489c5444 req-fdde9f97-255c-4cee-bb89-dfc25fda81dc service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-changed-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-5fd82b05-e172-4711-9eb5-d492489c5444 req-fdde9f97-255c-4cee-bb89-dfc25fda81dc service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Refreshing instance network info cache due to event network-changed-85389b0d-a54a-48df-b551-f057e727cb4f. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5fd82b05-e172-4711-9eb5-d492489c5444 req-fdde9f97-255c-4cee-bb89-dfc25fda81dc service nova] Acquiring lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Updating instance_info_cache with network_info: [{"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Releasing lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Instance network_info: |[{"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5fd82b05-e172-4711-9eb5-d492489c5444 req-fdde9f97-255c-4cee-bb89-dfc25fda81dc service nova] Acquired lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG nova.network.neutron [req-5fd82b05-e172-4711-9eb5-d492489c5444 req-fdde9f97-255c-4cee-bb89-dfc25fda81dc service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Refreshing network info cache for port 85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:27:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:56 user nova-compute[75205]: INFO nova.compute.manager [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Terminating instance
Nov 14 19:27:56 user nova-compute[75205]: DEBUG nova.compute.manager [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG nova.network.neutron [req-5fd82b05-e172-4711-9eb5-d492489c5444 req-fdde9f97-255c-4cee-bb89-dfc25fda81dc service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Updated VIF entry in instance network info cache for port 85389b0d-a54a-48df-b551-f057e727cb4f. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG nova.network.neutron [req-5fd82b05-e172-4711-9eb5-d492489c5444 req-fdde9f97-255c-4cee-bb89-dfc25fda81dc service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Updating instance_info_cache with network_info: [{"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5fd82b05-e172-4711-9eb5-d492489c5444 req-fdde9f97-255c-4cee-bb89-dfc25fda81dc service nova] Releasing lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG nova.compute.manager [req-d39f7073-9365-4793-9691-e7c3aeda47db req-df95ecdb-c877-4341-827e-3030f9934bff service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-vif-unplugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d39f7073-9365-4793-9691-e7c3aeda47db req-df95ecdb-c877-4341-827e-3030f9934bff service nova] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d39f7073-9365-4793-9691-e7c3aeda47db req-df95ecdb-c877-4341-827e-3030f9934bff service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d39f7073-9365-4793-9691-e7c3aeda47db req-df95ecdb-c877-4341-827e-3030f9934bff service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG nova.compute.manager [req-d39f7073-9365-4793-9691-e7c3aeda47db req-df95ecdb-c877-4341-827e-3030f9934bff service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] No waiting events found dispatching network-vif-unplugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG nova.compute.manager [req-d39f7073-9365-4793-9691-e7c3aeda47db req-df95ecdb-c877-4341-827e-3030f9934bff service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-vif-unplugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:27:56 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Instance destroyed successfully.
Nov 14 19:27:56 user nova-compute[75205]: DEBUG nova.objects.instance [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'resources' on Instance uuid 6e5b652c-e7bf-4b77-bb84-db5c399cb538 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1591317232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1591317232',id=33,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY8BN4OSjDQM9rqpkJC6Z7KTJgav9yS3Me+QYcBpJkEthzcRB7SVixd0ikK9C5zzMHVLxnztcwbe3psghv24kPmGsvMk6DW7JWIN5RcYEAx2G7/gaedbeU38l6UAtrTqg==',key_name='tempest-keypair-1469195162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:25:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-sjq8e8cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=6e5b652c-e7bf-4b77-bb84-db5c399cb538,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "address": "fa:16:3e:b7:a9:40", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e59c6ca-91", "ovs_interfaceid": "9e59c6ca-9156-4128-bcff-efbf329ac5c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG os_vif [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e59c6ca-91, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbdd7180-bcd5-44ee-9dad-672ee2c8d519) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:56 user nova-compute[75205]: INFO os_vif [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a9:40,bridge_name='br-int',has_traffic_filtering=True,id=9e59c6ca-9156-4128-bcff-efbf329ac5c6,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e59c6ca-91')
Nov 14 19:27:56 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Deleting instance files /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538_del
Nov 14 19:27:56 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Deletion of /opt/stack/data/nova/instances/6e5b652c-e7bf-4b77-bb84-db5c399cb538_del complete
Nov 14 19:27:57 user nova-compute[75205]: INFO nova.compute.manager [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 19:27:57 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:27:57 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:27:57 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:27:57 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:57 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Took 0.67 seconds to deallocate network for instance.
Nov 14 19:27:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-2c9d5eb7-a83e-43e4-8326-daf7f10f1a2a req-e696b29f-928a-47d1-b890-b6df374c0a21 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-vif-deleted-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:57 user nova-compute[75205]: INFO nova.compute.manager [req-2c9d5eb7-a83e-43e4-8326-daf7f10f1a2a req-e696b29f-928a-47d1-b890-b6df374c0a21 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Neutron deleted interface 9e59c6ca-9156-4128-bcff-efbf329ac5c6; detaching it from the instance and deleting it from the info cache
Nov 14 19:27:57 user nova-compute[75205]: DEBUG nova.network.neutron [req-2c9d5eb7-a83e-43e4-8326-daf7f10f1a2a req-e696b29f-928a-47d1-b890-b6df374c0a21 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-2c9d5eb7-a83e-43e4-8326-daf7f10f1a2a req-e696b29f-928a-47d1-b890-b6df374c0a21 service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Detach interface failed, port_id=9e59c6ca-9156-4128-bcff-efbf329ac5c6, reason: Instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:27:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:58 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Deleted allocations for instance 6e5b652c-e7bf-4b77-bb84-db5c399cb538
Nov 14 19:27:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-01ebb037-f7d9-44b1-a108-d3908335e74e tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "6e3657fa-d795-4732-852a-158c68452387" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "6e3657fa-d795-4732-852a-158c68452387" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "6e3657fa-d795-4732-852a-158c68452387-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "6e3657fa-d795-4732-852a-158c68452387-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "6e3657fa-d795-4732-852a-158c68452387-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:58 user nova-compute[75205]: INFO nova.compute.manager [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Terminating instance
Nov 14 19:27:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-59f8f874-2868-4c9d-a0a6-fa16cf819051 req-5873c7fc-3b9f-4c56-af90-e3d9f5cccefa service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-59f8f874-2868-4c9d-a0a6-fa16cf819051 req-5873c7fc-3b9f-4c56-af90-e3d9f5cccefa service nova] Acquiring lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-59f8f874-2868-4c9d-a0a6-fa16cf819051 req-5873c7fc-3b9f-4c56-af90-e3d9f5cccefa service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-59f8f874-2868-4c9d-a0a6-fa16cf819051 req-5873c7fc-3b9f-4c56-af90-e3d9f5cccefa service nova] Lock "6e5b652c-e7bf-4b77-bb84-db5c399cb538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-59f8f874-2868-4c9d-a0a6-fa16cf819051 req-5873c7fc-3b9f-4c56-af90-e3d9f5cccefa service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] No waiting events found dispatching network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:27:58 user nova-compute[75205]: WARNING nova.compute.manager [req-59f8f874-2868-4c9d-a0a6-fa16cf819051 req-5873c7fc-3b9f-4c56-af90-e3d9f5cccefa service nova] [instance: 6e5b652c-e7bf-4b77-bb84-db5c399cb538] Received unexpected event network-vif-plugged-9e59c6ca-9156-4128-bcff-efbf329ac5c6 for instance with vm_state deleted and task_state None.
Nov 14 19:27:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:27:59 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Creating image(s)
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Ensure instance console log exists: /opt/stack/data/nova/instances/602429d1-cfd8-4984-97db-b086f9d1ecfd/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Start _get_guest_xml network_info=[{"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EiByouVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '602429d1-cfd8-4984-97db-b086f9d1ecfd', 'attached_at': '', 'detached_at': '', 'volume_id': '5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 'serial': '5384e6fc-7619-469f-8b8d-0a8cfdaa350c'}, 'attachment_id': '235551db-b6c7-422c-b6bf-39b75f28eac8', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:27:59 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 6e3657fa-d795-4732-852a-158c68452387] Instance destroyed successfully.
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.objects.instance [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lazy-loading 'resources' on Instance uuid 6e3657fa-d795-4732-852a-158c68452387 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:27:59 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:27:59 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:08:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-84222374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-84222374',id=2,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:08:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde587867310451cab4f464b330555af',ramdisk_id='',reservation_id='r-wtn1v6pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:10:18Z,user_data=None,user_id='d0ee9d2093e64175b45b3b4d99b5648f',uuid=6e3657fa-d795-4732-852a-158c68452387,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converting VIF {"id": "33605006-0418-423d-b2f9-f7ac03767374", "address": "fa:16:3e:f9:d2:85", "network": {"id": "fd4d249b-9e27-4044-89ac-0facef0c20f3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-725448105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fde587867310451cab4f464b330555af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33605006-04", "ovs_interfaceid": "33605006-0418-423d-b2f9-f7ac03767374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=33605006-0418-423d-b2f9-f7ac03767374,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33605006-04') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_vif [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=33605006-0418-423d-b2f9-f7ac03767374,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33605006-04') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33605006-04, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EiByouVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:27:59 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:27:59 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:27:59 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:27:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b03c7a91-f6a7-47ee-970a-d7697d6e0234) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:27:59 user nova-compute[75205]: INFO os_vif [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=33605006-0418-423d-b2f9-f7ac03767374,network=Network(fd4d249b-9e27-4044-89ac-0facef0c20f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33605006-04')
Nov 14 19:27:59 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Deleting instance files /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387_del
Nov 14 19:27:59 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Deletion of /opt/stack/data/nova/instances/6e3657fa-d795-4732-852a-158c68452387_del complete
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f32b272-1ecf-468f-be35-83b10fc67ba0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:27:59 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eea8e6-7e7e-497b-94dd-a9ad79bf46fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c] added
Nov 14 19:27:59 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7042dd-e43b-48b9-ac6c-157d2c372c06]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: INFO nova.compute.manager [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] [instance: 6e3657fa-d795-4732-852a-158c68452387] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 6e3657fa-d795-4732-852a-158c68452387] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 6e3657fa-d795-4732-852a-158c68452387] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e401b11-1f5d-486c-bae7-1838e0f677bf]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EiByouVP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EiByouVP" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb67a010-c7c9-4011-8483-c9a1bd6ec5c9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EiByouVP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[881463e8-c25b-453a-b444-70f9310c6c15]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d606204e-c6b9-47a5-b541-fb72d7f98a3d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:27:59 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:27:59 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b2bb58-f3d9-4e80-96d9-9ba44113193f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260]
Nov 14 19:27:59 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260] successful.
Nov 14 19:27:59 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d290b977-6811-41b1-ba88-0a8aa85acea0]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed21afa-4300-47f0-bb10-7e21324448a7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:27:59 user nova-compute[75205]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:27:59 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:27:59 user nova-compute[75205]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:27:59 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e29148-760c-4ed1-8669-88c0c94fa1ea]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EiByouVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:59 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 6e3657fa-d795-4732-852a-158c68452387] Took 0.45 seconds to deallocate network for instance.
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-c3f71a9e-7990-4808-9acc-405df2e49315 req-ef1115e2-f972-4bc9-9ccc-fe0fef22bd28 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Received event network-vif-deleted-33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:27:59 user nova-compute[75205]: INFO nova.compute.manager [req-c3f71a9e-7990-4808-9acc-405df2e49315 req-ef1115e2-f972-4bc9-9ccc-fe0fef22bd28 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Neutron deleted interface 33605006-0418-423d-b2f9-f7ac03767374; detaching it from the instance and deleting it from the info cache
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.network.neutron [req-c3f71a9e-7990-4808-9acc-405df2e49315 req-ef1115e2-f972-4bc9-9ccc-fe0fef22bd28 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG nova.compute.manager [req-c3f71a9e-7990-4808-9acc-405df2e49315 req-ef1115e2-f972-4bc9-9ccc-fe0fef22bd28 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Detach interface failed, port_id=33605006-0418-423d-b2f9-f7ac03767374, reason: Instance 6e3657fa-d795-4732-852a-158c68452387 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:27:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:00 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Deleted allocations for instance 6e3657fa-d795-4732-852a-158c68452387
Nov 14 19:28:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-829b5dac-36a7-4b81-af51-49ab359bad88 tempest-ServerBootFromVolumeStableRescueTest-2146587572 tempest-ServerBootFromVolumeStableRescueTest-2146587572-project-member] Lock "6e3657fa-d795-4732-852a-158c68452387" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.772s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Received event network-vif-unplugged-33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] Acquiring lock "6e3657fa-d795-4732-852a-158c68452387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] Lock "6e3657fa-d795-4732-852a-158c68452387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] Lock "6e3657fa-d795-4732-852a-158c68452387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] No waiting events found dispatching network-vif-unplugged-33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:00 user nova-compute[75205]: WARNING nova.compute.manager [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Received unexpected event network-vif-unplugged-33605006-0418-423d-b2f9-f7ac03767374 for instance with vm_state deleted and task_state None.
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Received event network-vif-plugged-33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] Acquiring lock "6e3657fa-d795-4732-852a-158c68452387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] Lock "6e3657fa-d795-4732-852a-158c68452387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] Lock "6e3657fa-d795-4732-852a-158c68452387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] No waiting events found dispatching network-vif-plugged-33605006-0418-423d-b2f9-f7ac03767374 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:00 user nova-compute[75205]: WARNING nova.compute.manager [req-84c5663d-f2c3-4439-9bdc-ab9f4ef1dcb0 req-f194d4f3-a0e6-4895-aecf-fd52911a9ef3 service nova] [instance: 6e3657fa-d795-4732-852a-158c68452387] Received unexpected event network-vif-plugged-33605006-0418-423d-b2f9-f7ac03767374 for instance with vm_state deleted and task_state None.
Nov 14 19:28:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23466383763393266', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466383763393266', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-319623074',display_name='tempest-TestVolumeBootPattern-server-319623074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-319623074',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4lflwSUeyVbH81QiQ0Uh3cKzramHeRM7aduqUtZ4pb3+SjiUT5tItPthN7NGlihkCZ2OzXolgwmiBolVRT+jaN4ru1XGIc7ZtqCPOyOWGe8i2eYeT/Jps/FMv13SMF/w==',key_name='tempest-TestVolumeBootPattern-186737572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-bsvta9p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:27:54Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=602429d1-cfd8-4984-97db-b086f9d1ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:6d:ba,bridge_name='br-int',has_traffic_filtering=True,id=85389b0d-a54a-48df-b551-f057e727cb4f,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85389b0d-a5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'pci_devices' on Instance uuid 602429d1-cfd8-4984-97db-b086f9d1ecfd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:28:00 user nova-compute[75205]:   <uuid>602429d1-cfd8-4984-97db-b086f9d1ecfd</uuid>
Nov 14 19:28:00 user nova-compute[75205]:   <name>instance-00000027</name>
Nov 14 19:28:00 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:28:00 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:28:00 user nova-compute[75205]:   <metadata>
Nov 14 19:28:00 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:28:00 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:28:00 user nova-compute[75205]:       <nova:name>tempest-TestVolumeBootPattern-server-319623074</nova:name>
Nov 14 19:28:00 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:27:59</nova:creationTime>
Nov 14 19:28:00 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:28:00 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:28:00 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:28:00 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:28:00 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:28:00 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:28:00 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:28:00 user nova-compute[75205]:       <nova:owner>
Nov 14 19:28:00 user nova-compute[75205]:         <nova:user uuid="06b3b7a0f2ae441f8cb1d50891fcab94">tempest-TestVolumeBootPattern-397278786-project-member</nova:user>
Nov 14 19:28:00 user nova-compute[75205]:         <nova:project uuid="e2fe039dc34949509e4ad72cd9da3bf1">tempest-TestVolumeBootPattern-397278786</nova:project>
Nov 14 19:28:00 user nova-compute[75205]:       </nova:owner>
Nov 14 19:28:00 user nova-compute[75205]:       <nova:ports>
Nov 14 19:28:00 user nova-compute[75205]:         <nova:port uuid="85389b0d-a54a-48df-b551-f057e727cb4f">
Nov 14 19:28:00 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 19:28:00 user nova-compute[75205]:         </nova:port>
Nov 14 19:28:00 user nova-compute[75205]:       </nova:ports>
Nov 14 19:28:00 user nova-compute[75205]:     </nova:instance>
Nov 14 19:28:00 user nova-compute[75205]:   </metadata>
Nov 14 19:28:00 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:28:00 user nova-compute[75205]:     <system>
Nov 14 19:28:00 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:28:00 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:28:00 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:28:00 user nova-compute[75205]:       <entry name="serial">602429d1-cfd8-4984-97db-b086f9d1ecfd</entry>
Nov 14 19:28:00 user nova-compute[75205]:       <entry name="uuid">602429d1-cfd8-4984-97db-b086f9d1ecfd</entry>
Nov 14 19:28:00 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:28:00 user nova-compute[75205]:     </system>
Nov 14 19:28:00 user nova-compute[75205]:   </sysinfo>
Nov 14 19:28:00 user nova-compute[75205]:   <os>
Nov 14 19:28:00 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:28:00 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:28:00 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:28:00 user nova-compute[75205]:   </os>
Nov 14 19:28:00 user nova-compute[75205]:   <features>
Nov 14 19:28:00 user nova-compute[75205]:     <acpi/>
Nov 14 19:28:00 user nova-compute[75205]:     <apic/>
Nov 14 19:28:00 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:28:00 user nova-compute[75205]:   </features>
Nov 14 19:28:00 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:28:00 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:28:00 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:28:00 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:28:00 user nova-compute[75205]:   </clock>
Nov 14 19:28:00 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:28:00 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:28:00 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:28:00 user nova-compute[75205]:   </cpu>
Nov 14 19:28:00 user nova-compute[75205]:   <devices>
Nov 14 19:28:00 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:28:00 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:28:00 user nova-compute[75205]:       <source dev="/dev/sdb"/>
Nov 14 19:28:00 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:28:00 user nova-compute[75205]:       <serial>5384e6fc-7619-469f-8b8d-0a8cfdaa350c</serial>
Nov 14 19:28:00 user nova-compute[75205]:     </disk>
Nov 14 19:28:00 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:28:00 user nova-compute[75205]:       <mac address="fa:16:3e:86:6d:ba"/>
Nov 14 19:28:00 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:28:00 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:28:00 user nova-compute[75205]:       <target dev="tap85389b0d-a5"/>
Nov 14 19:28:00 user nova-compute[75205]:     </interface>
Nov 14 19:28:00 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:28:00 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/602429d1-cfd8-4984-97db-b086f9d1ecfd/console.log" append="off"/>
Nov 14 19:28:00 user nova-compute[75205]:     </serial>
Nov 14 19:28:00 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:28:00 user nova-compute[75205]:     <video>
Nov 14 19:28:00 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:28:00 user nova-compute[75205]:     </video>
Nov 14 19:28:00 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:28:00 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:28:00 user nova-compute[75205]:     </rng>
Nov 14 19:28:00 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:28:00 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:28:00 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:28:00 user nova-compute[75205]:     </memballoon>
Nov 14 19:28:00 user nova-compute[75205]:   </devices>
Nov 14 19:28:00 user nova-compute[75205]: </domain>
Nov 14 19:28:00 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-319623074',display_name='tempest-TestVolumeBootPattern-server-319623074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-319623074',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4lflwSUeyVbH81QiQ0Uh3cKzramHeRM7aduqUtZ4pb3+SjiUT5tItPthN7NGlihkCZ2OzXolgwmiBolVRT+jaN4ru1XGIc7ZtqCPOyOWGe8i2eYeT/Jps/FMv13SMF/w==',key_name='tempest-TestVolumeBootPattern-186737572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-bsvta9p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:27:54Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=602429d1-cfd8-4984-97db-b086f9d1ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:6d:ba,bridge_name='br-int',has_traffic_filtering=True,id=85389b0d-a54a-48df-b551-f057e727cb4f,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85389b0d-a5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG os_vif [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6d:ba,bridge_name='br-int',has_traffic_filtering=True,id=85389b0d-a54a-48df-b551-f057e727cb4f,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85389b0d-a5') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30abfb1a-741a-5646-af7e-d56bb880d878', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85389b0d-a5, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85389b0d-a5, col_values=(('qos', UUID('bfbf4205-74cc-45b1-845f-f925a112d7b0')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85389b0d-a5, col_values=(('external_ids', {'iface-id': '85389b0d-a54a-48df-b551-f057e727cb4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:6d:ba', 'vm-uuid': '602429d1-cfd8-4984-97db-b086f9d1ecfd'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:00 user nova-compute[75205]: INFO os_vif [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6d:ba,bridge_name='br-int',has_traffic_filtering=True,id=85389b0d-a54a-48df-b551-f057e727cb4f,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85389b0d-a5')
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:28:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No VIF found with MAC fa:16:3e:86:6d:ba, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:28:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-b1b9f99c-75ea-4329-b167-b9c8065f86cc req-1a5b4102-a0a0-4471-b495-e33abe962140 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b1b9f99c-75ea-4329-b167-b9c8065f86cc req-1a5b4102-a0a0-4471-b495-e33abe962140 service nova] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b1b9f99c-75ea-4329-b167-b9c8065f86cc req-1a5b4102-a0a0-4471-b495-e33abe962140 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b1b9f99c-75ea-4329-b167-b9c8065f86cc req-1a5b4102-a0a0-4471-b495-e33abe962140 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:02 user nova-compute[75205]: DEBUG nova.compute.manager [req-b1b9f99c-75ea-4329-b167-b9c8065f86cc req-1a5b4102-a0a0-4471-b495-e33abe962140 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] No waiting events found dispatching network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:02 user nova-compute[75205]: WARNING nova.compute.manager [req-b1b9f99c-75ea-4329-b167-b9c8065f86cc req-1a5b4102-a0a0-4471-b495-e33abe962140 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received unexpected event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f for instance with vm_state building and task_state spawning.
Nov 14 19:28:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:28:04 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Instance spawned successfully.
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:04 user nova-compute[75205]: INFO nova.compute.manager [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-aa7b5ce8-0b4a-42b1-b03c-17b3aaaa3d26 req-227ed2f7-8964-4c51-acd8-17fab2555e6d service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-aa7b5ce8-0b4a-42b1-b03c-17b3aaaa3d26 req-227ed2f7-8964-4c51-acd8-17fab2555e6d service nova] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-aa7b5ce8-0b4a-42b1-b03c-17b3aaaa3d26 req-227ed2f7-8964-4c51-acd8-17fab2555e6d service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-aa7b5ce8-0b4a-42b1-b03c-17b3aaaa3d26 req-227ed2f7-8964-4c51-acd8-17fab2555e6d service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-aa7b5ce8-0b4a-42b1-b03c-17b3aaaa3d26 req-227ed2f7-8964-4c51-acd8-17fab2555e6d service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] No waiting events found dispatching network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:04 user nova-compute[75205]: WARNING nova.compute.manager [req-aa7b5ce8-0b4a-42b1-b03c-17b3aaaa3d26 req-227ed2f7-8964-4c51-acd8-17fab2555e6d service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received unexpected event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f for instance with vm_state building and task_state spawning.
Nov 14 19:28:04 user nova-compute[75205]: INFO nova.compute.manager [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Took 10.47 seconds to build instance.
Nov 14 19:28:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ceb5cd16-ea13-493e-900b-f69aebfd65e3 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.574s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-66fbe893-57ba-4d56-be45-be18e32ffdea req-45b56021-c1a3-4270-8a40-4407c23caa9f service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received event network-changed-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-66fbe893-57ba-4d56-be45-be18e32ffdea req-45b56021-c1a3-4270-8a40-4407c23caa9f service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Refreshing instance network info cache due to event network-changed-b53ded48-7665-4249-884c-8c0938a57fa0. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:28:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-66fbe893-57ba-4d56-be45-be18e32ffdea req-45b56021-c1a3-4270-8a40-4407c23caa9f service nova] Acquiring lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:28:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-66fbe893-57ba-4d56-be45-be18e32ffdea req-45b56021-c1a3-4270-8a40-4407c23caa9f service nova] Acquired lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:28:07 user nova-compute[75205]: DEBUG nova.network.neutron [req-66fbe893-57ba-4d56-be45-be18e32ffdea req-45b56021-c1a3-4270-8a40-4407c23caa9f service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Refreshing network info cache for port b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:28:08 user nova-compute[75205]: DEBUG nova.network.neutron [req-66fbe893-57ba-4d56-be45-be18e32ffdea req-45b56021-c1a3-4270-8a40-4407c23caa9f service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updated VIF entry in instance network info cache for port b53ded48-7665-4249-884c-8c0938a57fa0. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:28:08 user nova-compute[75205]: DEBUG nova.network.neutron [req-66fbe893-57ba-4d56-be45-be18e32ffdea req-45b56021-c1a3-4270-8a40-4407c23caa9f service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updating instance_info_cache with network_info: [{"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:28:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-66fbe893-57ba-4d56-be45-be18e32ffdea req-45b56021-c1a3-4270-8a40-4407c23caa9f service nova] Releasing lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:28:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Stashing vm_state: active {{(pid=75205) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 19:28:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:09 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:28:09 user nova-compute[75205]: INFO nova.compute.claims [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Claim successful on node user
Nov 14 19:28:09 user nova-compute[75205]: INFO nova.compute.resource_tracker [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating resource usage from migration f47fa527-9ad7-4f1a-8041-7f47f67d3c8d
Nov 14 19:28:09 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:28:09 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:28:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.349s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:09 user nova-compute[75205]: INFO nova.compute.manager [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Migrating
Nov 14 19:28:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:28:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquired lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:28:09 user nova-compute[75205]: DEBUG nova.network.neutron [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-713af553-34d5-41e7-9767-9bbc0bb02c49 req-ed5b35d3-0cdc-423c-9cdf-c8e65ff0b296 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-changed-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-713af553-34d5-41e7-9767-9bbc0bb02c49 req-ed5b35d3-0cdc-423c-9cdf-c8e65ff0b296 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Refreshing instance network info cache due to event network-changed-b852cc39-4e71-4a5e-bbbd-6dfd30715442. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-713af553-34d5-41e7-9767-9bbc0bb02c49 req-ed5b35d3-0cdc-423c-9cdf-c8e65ff0b296 service nova] Acquiring lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG nova.network.neutron [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating instance_info_cache with network_info: [{"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Releasing lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-713af553-34d5-41e7-9767-9bbc0bb02c49 req-ed5b35d3-0cdc-423c-9cdf-c8e65ff0b296 service nova] Acquired lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG nova.network.neutron [req-713af553-34d5-41e7-9767-9bbc0bb02c49 req-ed5b35d3-0cdc-423c-9cdf-c8e65ff0b296 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Refreshing network info cache for port b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Starting migrate_disk_and_power_off {{(pid=75205) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG nova.network.neutron [req-713af553-34d5-41e7-9767-9bbc0bb02c49 req-ed5b35d3-0cdc-423c-9cdf-c8e65ff0b296 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updated VIF entry in instance network info cache for port b852cc39-4e71-4a5e-bbbd-6dfd30715442. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG nova.network.neutron [req-713af553-34d5-41e7-9767-9bbc0bb02c49 req-ed5b35d3-0cdc-423c-9cdf-c8e65ff0b296 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating instance_info_cache with network_info: [{"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:28:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-713af553-34d5-41e7-9767-9bbc0bb02c49 req-ed5b35d3-0cdc-423c-9cdf-c8e65ff0b296 service nova] Releasing lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:28:11 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Instance destroyed successfully.
Nov 14 19:28:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-120934111',display_name='tempest-ServerActionsTestOtherA-server-120934111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-120934111',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3OJYMfErFiTGe/qVImPNNpMoleZ3J9mAlhBnKRLLztrPxOuSUjWBVerPUHNAmA4WwUUZXCuLX5O2r/5K813hJJaeAm4LX+jg/1ArdxTUJxjig4g1+w8aJwtp9ZiKaoQA==',key_name='tempest-keypair-1933539898',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:26:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-4ckfg9fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=298a5eb2-6362-40bd-93fa-2cad9b07718a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-217010368-network", "vif_mac": "fa:16:3e:68:ac:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-217010368-network", "vif_mac": "fa:16:3e:68:ac:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_vif [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb852cc39-4e, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32226e23-da3a-42db-9184-d8d67ecd0b8d) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:11 user nova-compute[75205]: INFO os_vif [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e')
Nov 14 19:28:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vImMOBrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:28:11 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba49540-c3e0-4cb2-b0c5-4a7fddc9465e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:28:11 user nova-compute[75205]: No targets found.
Nov 14 19:28:11 user nova-compute[75205]: iSNS:
Nov 14 19:28:11 user nova-compute[75205]: No targets found.
Nov 14 19:28:11 user nova-compute[75205]: STATIC:
Nov 14 19:28:11 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a
Nov 14 19:28:11 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:28:11 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:28:11 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c
Nov 14 19:28:11 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:28:11 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:28:11 user nova-compute[75205]: FIRMWARE:
Nov 14 19:28:11 user nova-compute[75205]: No targets found.
Nov 14 19:28:11 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:28:11 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:28:11 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57a2c67-5169-4b85-a7da-d11cbd3fe705]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8aca9f-536c-425a-8a9c-ed63e11ebfce]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:28:11 user nova-compute[75205]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:28:11 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:28:11 user nova-compute[75205]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:28:11 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7410b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a'): ({'sde'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Removing single pathed devices sde {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3828d5f-14c3-4d4c-9f92-dc16cb8f66fe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf1f102-559d-41c2-bbf3-1732dd028373]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flushing IO for device /dev/sde {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f1308-e0e0-4df5-8edb-57b33ddff3c8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ac2b06-0e21-4912-b661-03e230230b86]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8c19fcc3-fea06290435d6a4f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8c19fcc3', '/dev/disk/by-id/scsi-26665613036323930') {{(pid=85714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef988399-7605-471b-a20e-152d73fae49a]: (4, None) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[93787c6a-6aad-43f8-8a19-b3e507775827]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[402ccf56-359a-4651-9157-ebcbe7b752e8]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260]
Nov 14 19:28:11 user nova-compute[75205]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260] successful.
Nov 14 19:28:11 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afc2d32-3257-4c74-9e32-51db8b2804aa]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== disconnect_volume: return (298ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:28:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-vif-unplugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] No waiting events found dispatching network-vif-unplugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:12 user nova-compute[75205]: WARNING nova.compute.manager [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received unexpected event network-vif-unplugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 for instance with vm_state active and task_state resize_migrating.
Nov 14 19:28:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG nova.compute.manager [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] No waiting events found dispatching network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:12 user nova-compute[75205]: WARNING nova.compute.manager [req-d08b08c6-730b-48b8-91ce-7ecbbb0f3caf req-15dab2f9-898f-4b88-9ed8-ce10c41086c5 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received unexpected event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 for instance with vm_state active and task_state resize_migrating.
Nov 14 19:28:12 user nova-compute[75205]: DEBUG nova.network.neutron [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Port b852cc39-4e71-4a5e-bbbd-6dfd30715442 binding to destination host user is already ACTIVE {{(pid=75205) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquired lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG nova.network.neutron [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG nova.network.neutron [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating instance_info_cache with network_info: [{"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Releasing lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG os_brick.utils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a08a6d0-e416-4119-bce5-d55d0b662f43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef15b92-7d2b-4b51-b97c-71b31b546c43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dd13d2-26d3-4d6f-8630-3fff2cd6e92b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee27e691-fe9f-4f90-a421-ea2279118a13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:28:13 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:28:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad6e5f-7e33-4972-aeb7-92821b2853f7]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:28:13 user nova-compute[75205]: DEBUG os_brick.utils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:28:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Starting finish_migration {{(pid=75205) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Instance directory exists: not creating {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 19:28:17 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Creating image(s)
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Ensure instance console log exists: /opt/stack/data/nova/instances/298a5eb2-6362-40bd-93fa-2cad9b07718a/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Start _get_guest_xml network_info=[{"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-217010368-network", "vif_mac": "fa:16:3e:68:ac:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vImMOBrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '298a5eb2-6362-40bd-93fa-2cad9b07718a', 'attached_at': '2023-11-14T19:28:17.000000', 'detached_at': '', 'volume_id': '788c1a35-e7c1-4da1-b718-549567f2da3a', 'serial': '788c1a35-e7c1-4da1-b718-549567f2da3a'}, 'attachment_id': '95a59147-ba61-4882-a2d5-29e41a04f5fe', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:28:17 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:28:17 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vImMOBrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:28:17 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:28:17 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:28:17 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fa5114-63e2-43f7-ad5d-f8acb36a4b70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:28:17 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7466a89-80ea-4c54-802b-ca8401b7f7b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a] added
Nov 14 19:28:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b5a094-9d89-4e4d-ad2e-974df9d59e95]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8787bc41-4d77-41c3-88a3-fd993427e151]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vImMOBrF {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vImMOBrF" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c640a14-2fd3-4bc3-821e-0e88fcb19718]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vImMOBrF'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1af118-fa4f-4954-bfc6-6b112fcc1f23]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[974e5249-be95-4916-a0b2-d167fde65a19]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:28:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:28:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:28:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --login" returned: 0 in 1.054s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e33f1b7-85bc-40ba-8de7-e0533a0f7995]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260]
Nov 14 19:28:18 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260] successful.
Nov 14 19:28:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e244df01-3c31-4694-aa0d-5fa402daaa89]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4461581a-3741-4ed3-b11d-68849ff4fc01]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:28:18 user nova-compute[75205]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:28:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:28:18 user nova-compute[75205]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:28:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.275s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[662a3e08-3e66-4622-b90b-ed1ad6f45307]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:28:18 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vImMOBrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.303s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== connect_volume: return (2304ms) {'type': 'block', 'scsi_wwn': '26665613036323930', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665613036323930', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-120934111',display_name='tempest-ServerActionsTestOtherA-server-120934111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-120934111',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3OJYMfErFiTGe/qVImPNNpMoleZ3J9mAlhBnKRLLztrPxOuSUjWBVerPUHNAmA4WwUUZXCuLX5O2r/5K813hJJaeAm4LX+jg/1ArdxTUJxjig4g1+w8aJwtp9ZiKaoQA==',key_name='tempest-keypair-1933539898',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:26:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-4ckfg9fe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=298a5eb2-6362-40bd-93fa-2cad9b07718a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-217010368-network", "vif_mac": "fa:16:3e:68:ac:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-217010368-network", "vif_mac": "fa:16:3e:68:ac:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:28:19 user nova-compute[75205]:   <uuid>298a5eb2-6362-40bd-93fa-2cad9b07718a</uuid>
Nov 14 19:28:19 user nova-compute[75205]:   <name>instance-00000026</name>
Nov 14 19:28:19 user nova-compute[75205]:   <memory>2097152</memory>
Nov 14 19:28:19 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:28:19 user nova-compute[75205]:   <metadata>
Nov 14 19:28:19 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:28:19 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:28:19 user nova-compute[75205]:       <nova:name>tempest-ServerActionsTestOtherA-server-120934111</nova:name>
Nov 14 19:28:19 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:28:17</nova:creationTime>
Nov 14 19:28:19 user nova-compute[75205]:       <nova:flavor name="m1.small">
Nov 14 19:28:19 user nova-compute[75205]:         <nova:memory>2048</nova:memory>
Nov 14 19:28:19 user nova-compute[75205]:         <nova:disk>20</nova:disk>
Nov 14 19:28:19 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:28:19 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:28:19 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:28:19 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:28:19 user nova-compute[75205]:       <nova:owner>
Nov 14 19:28:19 user nova-compute[75205]:         <nova:user uuid="f89ca9b3c52040acbc46581ac5cf55b9">tempest-ServerActionsTestOtherA-410645410-project-member</nova:user>
Nov 14 19:28:19 user nova-compute[75205]:         <nova:project uuid="55021da245654f6392681359d51cbc9d">tempest-ServerActionsTestOtherA-410645410</nova:project>
Nov 14 19:28:19 user nova-compute[75205]:       </nova:owner>
Nov 14 19:28:19 user nova-compute[75205]:       <nova:ports>
Nov 14 19:28:19 user nova-compute[75205]:         <nova:port uuid="b852cc39-4e71-4a5e-bbbd-6dfd30715442">
Nov 14 19:28:19 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 19:28:19 user nova-compute[75205]:         </nova:port>
Nov 14 19:28:19 user nova-compute[75205]:       </nova:ports>
Nov 14 19:28:19 user nova-compute[75205]:     </nova:instance>
Nov 14 19:28:19 user nova-compute[75205]:   </metadata>
Nov 14 19:28:19 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:28:19 user nova-compute[75205]:     <system>
Nov 14 19:28:19 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:28:19 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:28:19 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:28:19 user nova-compute[75205]:       <entry name="serial">298a5eb2-6362-40bd-93fa-2cad9b07718a</entry>
Nov 14 19:28:19 user nova-compute[75205]:       <entry name="uuid">298a5eb2-6362-40bd-93fa-2cad9b07718a</entry>
Nov 14 19:28:19 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:28:19 user nova-compute[75205]:     </system>
Nov 14 19:28:19 user nova-compute[75205]:   </sysinfo>
Nov 14 19:28:19 user nova-compute[75205]:   <os>
Nov 14 19:28:19 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:28:19 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:28:19 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:28:19 user nova-compute[75205]:   </os>
Nov 14 19:28:19 user nova-compute[75205]:   <features>
Nov 14 19:28:19 user nova-compute[75205]:     <acpi/>
Nov 14 19:28:19 user nova-compute[75205]:     <apic/>
Nov 14 19:28:19 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:28:19 user nova-compute[75205]:   </features>
Nov 14 19:28:19 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:28:19 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:28:19 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:28:19 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:28:19 user nova-compute[75205]:   </clock>
Nov 14 19:28:19 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:28:19 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:28:19 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:28:19 user nova-compute[75205]:   </cpu>
Nov 14 19:28:19 user nova-compute[75205]:   <devices>
Nov 14 19:28:19 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:28:19 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:28:19 user nova-compute[75205]:       <source dev="/dev/sdc"/>
Nov 14 19:28:19 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:28:19 user nova-compute[75205]:       <serial>788c1a35-e7c1-4da1-b718-549567f2da3a</serial>
Nov 14 19:28:19 user nova-compute[75205]:     </disk>
Nov 14 19:28:19 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:28:19 user nova-compute[75205]:       <mac address="fa:16:3e:68:ac:59"/>
Nov 14 19:28:19 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:28:19 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:28:19 user nova-compute[75205]:       <target dev="tapb852cc39-4e"/>
Nov 14 19:28:19 user nova-compute[75205]:     </interface>
Nov 14 19:28:19 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:28:19 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/298a5eb2-6362-40bd-93fa-2cad9b07718a/console.log" append="off"/>
Nov 14 19:28:19 user nova-compute[75205]:     </serial>
Nov 14 19:28:19 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:28:19 user nova-compute[75205]:     <video>
Nov 14 19:28:19 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:28:19 user nova-compute[75205]:     </video>
Nov 14 19:28:19 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:28:19 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:28:19 user nova-compute[75205]:     </rng>
Nov 14 19:28:19 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:28:19 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:28:19 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:28:19 user nova-compute[75205]:     </memballoon>
Nov 14 19:28:19 user nova-compute[75205]:   </devices>
Nov 14 19:28:19 user nova-compute[75205]: </domain>
Nov 14 19:28:19 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-120934111',display_name='tempest-ServerActionsTestOtherA-server-120934111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-120934111',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3OJYMfErFiTGe/qVImPNNpMoleZ3J9mAlhBnKRLLztrPxOuSUjWBVerPUHNAmA4WwUUZXCuLX5O2r/5K813hJJaeAm4LX+jg/1ArdxTUJxjig4g1+w8aJwtp9ZiKaoQA==',key_name='tempest-keypair-1933539898',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:26:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-4ckfg9fe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=298a5eb2-6362-40bd-93fa-2cad9b07718a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-217010368-network", "vif_mac": "fa:16:3e:68:ac:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-217010368-network", "vif_mac": "fa:16:3e:68:ac:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG os_vif [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afdd41c0-a412-5dbe-938a-86dd2c4526e1', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb852cc39-4e, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb852cc39-4e, col_values=(('qos', UUID('3110651e-a4f7-4687-a80f-be430bff06eb')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb852cc39-4e, col_values=(('external_ids', {'iface-id': 'b852cc39-4e71-4a5e-bbbd-6dfd30715442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:ac:59', 'vm-uuid': '298a5eb2-6362-40bd-93fa-2cad9b07718a'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:19 user nova-compute[75205]: INFO os_vif [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e')
Nov 14 19:28:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:28:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] No VIF found with MAC fa:16:3e:68:ac:59, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:28:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:20 user nova-compute[75205]: INFO nova.compute.manager [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Terminating instance
Nov 14 19:28:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:28:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-574715d7-7218-4a7d-abdb-41eec28db703 req-290ffd6e-24e3-462f-ac56-a1a17955bb1f service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-vif-unplugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-574715d7-7218-4a7d-abdb-41eec28db703 req-290ffd6e-24e3-462f-ac56-a1a17955bb1f service nova] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-574715d7-7218-4a7d-abdb-41eec28db703 req-290ffd6e-24e3-462f-ac56-a1a17955bb1f service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-574715d7-7218-4a7d-abdb-41eec28db703 req-290ffd6e-24e3-462f-ac56-a1a17955bb1f service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-574715d7-7218-4a7d-abdb-41eec28db703 req-290ffd6e-24e3-462f-ac56-a1a17955bb1f service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] No waiting events found dispatching network-vif-unplugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG nova.compute.manager [req-574715d7-7218-4a7d-abdb-41eec28db703 req-290ffd6e-24e3-462f-ac56-a1a17955bb1f service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-vif-unplugged-a15f5508-d912-41f1-8459-a67ea57e481a for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Instance destroyed successfully.
Nov 14 19:28:21 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'resources' on Instance uuid 7803fcca-eed8-4088-b1dc-e0908dcecaa4 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-566278879',display_name='tempest-ServerRescueNegativeTestJSON-server-566278879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-566278879',id=17,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:14:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-3ob9ypcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:14:19Z,user_data=None,user_id='1b03af1014734b1a8d4c2633756070e8',uuid=7803fcca-eed8-4088-b1dc-e0908dcecaa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "a15f5508-d912-41f1-8459-a67ea57e481a", "address": "fa:16:3e:ee:dd:41", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15f5508-d9", "ovs_interfaceid": "a15f5508-d912-41f1-8459-a67ea57e481a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:dd:41,bridge_name='br-int',has_traffic_filtering=True,id=a15f5508-d912-41f1-8459-a67ea57e481a,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15f5508-d9') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG os_vif [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:dd:41,bridge_name='br-int',has_traffic_filtering=True,id=a15f5508-d912-41f1-8459-a67ea57e481a,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15f5508-d9') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa15f5508-d9, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e1ad7ea-e11c-4756-b04d-e955abc0a64d) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:21 user nova-compute[75205]: INFO os_vif [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:dd:41,bridge_name='br-int',has_traffic_filtering=True,id=a15f5508-d912-41f1-8459-a67ea57e481a,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15f5508-d9')
Nov 14 19:28:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Deleting instance files /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4_del
Nov 14 19:28:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Deletion of /opt/stack/data/nova/instances/7803fcca-eed8-4088-b1dc-e0908dcecaa4_del complete
Nov 14 19:28:21 user nova-compute[75205]: INFO nova.compute.manager [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 19:28:21 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:28:21 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:28:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:22 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:28:22 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Took 0.53 seconds to deallocate network for instance.
Nov 14 19:28:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-5d78e17a-f9e1-47a2-a2aa-94fe00cf02b9 req-abdd0600-e802-4553-9ab6-511361e50a8d service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-vif-deleted-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:22 user nova-compute[75205]: INFO nova.compute.manager [req-5d78e17a-f9e1-47a2-a2aa-94fe00cf02b9 req-abdd0600-e802-4553-9ab6-511361e50a8d service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Neutron deleted interface a15f5508-d912-41f1-8459-a67ea57e481a; detaching it from the instance and deleting it from the info cache
Nov 14 19:28:22 user nova-compute[75205]: DEBUG nova.network.neutron [req-5d78e17a-f9e1-47a2-a2aa-94fe00cf02b9 req-abdd0600-e802-4553-9ab6-511361e50a8d service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:28:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-5d78e17a-f9e1-47a2-a2aa-94fe00cf02b9 req-abdd0600-e802-4553-9ab6-511361e50a8d service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Detach interface failed, port_id=a15f5508-d912-41f1-8459-a67ea57e481a, reason: Instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:28:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:22 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:28:22 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:28:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:22 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Deleted allocations for instance 7803fcca-eed8-4088-b1dc-e0908dcecaa4
Nov 14 19:28:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5bf5fd8e-1e46-49ef-95ff-51fbf765f10c tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] Acquiring lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] Lock "7803fcca-eed8-4088-b1dc-e0908dcecaa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] No waiting events found dispatching network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:23 user nova-compute[75205]: WARNING nova.compute.manager [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] [instance: 7803fcca-eed8-4088-b1dc-e0908dcecaa4] Received unexpected event network-vif-plugged-a15f5508-d912-41f1-8459-a67ea57e481a for instance with vm_state deleted and task_state None.
Nov 14 19:28:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] No waiting events found dispatching network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:23 user nova-compute[75205]: WARNING nova.compute.manager [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received unexpected event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 for instance with vm_state active and task_state resize_finish.
Nov 14 19:28:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] No waiting events found dispatching network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:23 user nova-compute[75205]: WARNING nova.compute.manager [req-91377dac-275d-407b-a27b-ead83a775e90 req-d3c12287-4de2-4a21-ac0e-2332502de0c7 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received unexpected event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 for instance with vm_state active and task_state resize_finish.
Nov 14 19:28:23 user nova-compute[75205]: DEBUG nova.compute.manager [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:28:23 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Instance running successfully.
Nov 14 19:28:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Failed to set time: agent not configured {{(pid=75205) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 19:28:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-28c9163a-bea7-476a-94f5-fda6002162db tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] finish_migration finished successfully. {{(pid=75205) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 19:28:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:33 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:28:33 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:28:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:28:38 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:28:38 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8248MB free_disk=25.198612213134766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Applying migration context for instance 298a5eb2-6362-40bd-93fa-2cad9b07718a as it has an incoming, in-progress migration f47fa527-9ad7-4f1a-8041-7f47f67d3c8d. Migration status is finished {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 19:28:38 user nova-compute[75205]: INFO nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating resource usage from migration f47fa527-9ad7-4f1a-8041-7f47f67d3c8d
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7260ad81-fc37-4726-8fee-9adecb58040f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 602429d1-cfd8-4984-97db-b086f9d1ecfd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Migration f47fa527-9ad7-4f1a-8041-7f47f67d3c8d is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 298a5eb2-6362-40bd-93fa-2cad9b07718a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:28:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:41 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:28:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:28:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-7260ad81-fc37-4726-8fee-9adecb58040f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:28:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-7260ad81-fc37-4726-8fee-9adecb58040f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:28:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:28:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Updating instance_info_cache with network_info: [{"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:28:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-7260ad81-fc37-4726-8fee-9adecb58040f" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:28:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:28:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:28:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:28:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:28:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:28:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:28:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "22b41998-e98e-4797-b28d-db091cea8112" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:28:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:49 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:28:49 user nova-compute[75205]: INFO nova.compute.claims [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Claim successful on node user
Nov 14 19:28:50 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:28:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:28:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG nova.policy [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3e0b9e41b584048ae0c868ec72e89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bce9c4222254fe688cb54f69fe7bc4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:28:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Creating image(s)
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "/opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "/opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "/opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk 1073741824" returned: 0 in 0.049s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Successfully created port: 59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Cannot resize image /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Ensure instance console log exists: /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Successfully updated port: 59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquired lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-b1652740-d752-48d0-9643-e3f51adb0c3f req-753d7db7-fa3e-46ac-a24a-5a5a17c45054 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-changed-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-b1652740-d752-48d0-9643-e3f51adb0c3f req-753d7db7-fa3e-46ac-a24a-5a5a17c45054 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Refreshing instance network info cache due to event network-changed-59acb1f8-f517-493d-bab2-257903a6a353. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b1652740-d752-48d0-9643-e3f51adb0c3f req-753d7db7-fa3e-46ac-a24a-5a5a17c45054 service nova] Acquiring lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updating instance_info_cache with network_info: [{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Releasing lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance network_info: |[{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b1652740-d752-48d0-9643-e3f51adb0c3f req-753d7db7-fa3e-46ac-a24a-5a5a17c45054 service nova] Acquired lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.network.neutron [req-b1652740-d752-48d0-9643-e3f51adb0c3f req-753d7db7-fa3e-46ac-a24a-5a5a17c45054 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Refreshing network info cache for port 59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Start _get_guest_xml network_info=[{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:28:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:28:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948750380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948750380',id=40,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6NuEZLLKqjrnXTThDPmuk66mkWNn97l1L3F002JaTttyz5nOrN6mt3Nf9t7RNYYHJZFLY2/aIe4WNw25syEjYXJE259MN8mMXrHiRyQBeVh3lpD9FUpk1ebT2cG639ig==',key_name='tempest-keypair-1858313542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-9kjdv1bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=22b41998-e98e-4797-b28d-db091cea8112,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'pci_devices' on Instance uuid 22b41998-e98e-4797-b28d-db091cea8112 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:28:51 user nova-compute[75205]:   <uuid>22b41998-e98e-4797-b28d-db091cea8112</uuid>
Nov 14 19:28:51 user nova-compute[75205]:   <name>instance-00000028</name>
Nov 14 19:28:51 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:28:51 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:28:51 user nova-compute[75205]:   <metadata>
Nov 14 19:28:51 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:28:51 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:28:51 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-948750380</nova:name>
Nov 14 19:28:51 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:28:51</nova:creationTime>
Nov 14 19:28:51 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:28:51 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:28:51 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:28:51 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:28:51 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:28:51 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:28:51 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:28:51 user nova-compute[75205]:       <nova:owner>
Nov 14 19:28:51 user nova-compute[75205]:         <nova:user uuid="b3e0b9e41b584048ae0c868ec72e89a0">tempest-AttachVolumeShelveTestJSON-707756004-project-member</nova:user>
Nov 14 19:28:51 user nova-compute[75205]:         <nova:project uuid="1bce9c4222254fe688cb54f69fe7bc4a">tempest-AttachVolumeShelveTestJSON-707756004</nova:project>
Nov 14 19:28:51 user nova-compute[75205]:       </nova:owner>
Nov 14 19:28:51 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:28:51 user nova-compute[75205]:       <nova:ports>
Nov 14 19:28:51 user nova-compute[75205]:         <nova:port uuid="59acb1f8-f517-493d-bab2-257903a6a353">
Nov 14 19:28:51 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 19:28:51 user nova-compute[75205]:         </nova:port>
Nov 14 19:28:51 user nova-compute[75205]:       </nova:ports>
Nov 14 19:28:51 user nova-compute[75205]:     </nova:instance>
Nov 14 19:28:51 user nova-compute[75205]:   </metadata>
Nov 14 19:28:51 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:28:51 user nova-compute[75205]:     <system>
Nov 14 19:28:51 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:28:51 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:28:51 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:28:51 user nova-compute[75205]:       <entry name="serial">22b41998-e98e-4797-b28d-db091cea8112</entry>
Nov 14 19:28:51 user nova-compute[75205]:       <entry name="uuid">22b41998-e98e-4797-b28d-db091cea8112</entry>
Nov 14 19:28:51 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:28:51 user nova-compute[75205]:     </system>
Nov 14 19:28:51 user nova-compute[75205]:   </sysinfo>
Nov 14 19:28:51 user nova-compute[75205]:   <os>
Nov 14 19:28:51 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:28:51 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:28:51 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:28:51 user nova-compute[75205]:   </os>
Nov 14 19:28:51 user nova-compute[75205]:   <features>
Nov 14 19:28:51 user nova-compute[75205]:     <acpi/>
Nov 14 19:28:51 user nova-compute[75205]:     <apic/>
Nov 14 19:28:51 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:28:51 user nova-compute[75205]:   </features>
Nov 14 19:28:51 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:28:51 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:28:51 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:28:51 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:28:51 user nova-compute[75205]:   </clock>
Nov 14 19:28:51 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:28:51 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:28:51 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:28:51 user nova-compute[75205]:   </cpu>
Nov 14 19:28:51 user nova-compute[75205]:   <devices>
Nov 14 19:28:51 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:28:51 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:28:51 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk"/>
Nov 14 19:28:51 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:28:51 user nova-compute[75205]:     </disk>
Nov 14 19:28:51 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:28:51 user nova-compute[75205]:       <mac address="fa:16:3e:d9:4e:bd"/>
Nov 14 19:28:51 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:28:51 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:28:51 user nova-compute[75205]:       <target dev="tap59acb1f8-f5"/>
Nov 14 19:28:51 user nova-compute[75205]:     </interface>
Nov 14 19:28:51 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:28:51 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/console.log" append="off"/>
Nov 14 19:28:51 user nova-compute[75205]:     </serial>
Nov 14 19:28:51 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:28:51 user nova-compute[75205]:     <video>
Nov 14 19:28:51 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:28:51 user nova-compute[75205]:     </video>
Nov 14 19:28:51 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:28:51 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:28:51 user nova-compute[75205]:     </rng>
Nov 14 19:28:51 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:28:51 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:28:51 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:28:51 user nova-compute[75205]:     </memballoon>
Nov 14 19:28:51 user nova-compute[75205]:   </devices>
Nov 14 19:28:51 user nova-compute[75205]: </domain>
Nov 14 19:28:51 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948750380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948750380',id=40,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6NuEZLLKqjrnXTThDPmuk66mkWNn97l1L3F002JaTttyz5nOrN6mt3Nf9t7RNYYHJZFLY2/aIe4WNw25syEjYXJE259MN8mMXrHiRyQBeVh3lpD9FUpk1ebT2cG639ig==',key_name='tempest-keypair-1858313542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-9kjdv1bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=22b41998-e98e-4797-b28d-db091cea8112,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG os_vif [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '928026ab-561d-565f-83cb-4377ae016afc', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59acb1f8-f5, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59acb1f8-f5, col_values=(('qos', UUID('62fb2945-a5ba-40a5-89e6-2e079a4a7f2e')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59acb1f8-f5, col_values=(('external_ids', {'iface-id': '59acb1f8-f517-493d-bab2-257903a6a353', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:4e:bd', 'vm-uuid': '22b41998-e98e-4797-b28d-db091cea8112'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:51 user nova-compute[75205]: INFO os_vif [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5')
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:28:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] No VIF found with MAC fa:16:3e:d9:4e:bd, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:28:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-b1652740-d752-48d0-9643-e3f51adb0c3f req-753d7db7-fa3e-46ac-a24a-5a5a17c45054 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updated VIF entry in instance network info cache for port 59acb1f8-f517-493d-bab2-257903a6a353. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:28:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-b1652740-d752-48d0-9643-e3f51adb0c3f req-753d7db7-fa3e-46ac-a24a-5a5a17c45054 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updating instance_info_cache with network_info: [{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:28:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b1652740-d752-48d0-9643-e3f51adb0c3f req-753d7db7-fa3e-46ac-a24a-5a5a17c45054 service nova] Releasing lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:28:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-25086ef2-20d4-471e-b088-a24e8a4d7931 req-e045121b-bb23-4601-b53a-01d2c6978735 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-25086ef2-20d4-471e-b088-a24e8a4d7931 req-e045121b-bb23-4601-b53a-01d2c6978735 service nova] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-25086ef2-20d4-471e-b088-a24e8a4d7931 req-e045121b-bb23-4601-b53a-01d2c6978735 service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-25086ef2-20d4-471e-b088-a24e8a4d7931 req-e045121b-bb23-4601-b53a-01d2c6978735 service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-25086ef2-20d4-471e-b088-a24e8a4d7931 req-e045121b-bb23-4601-b53a-01d2c6978735 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] No waiting events found dispatching network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:53 user nova-compute[75205]: WARNING nova.compute.manager [req-25086ef2-20d4-471e-b088-a24e8a4d7931 req-e045121b-bb23-4601-b53a-01d2c6978735 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received unexpected event network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 for instance with vm_state building and task_state spawning.
Nov 14 19:28:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:28:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance spawned successfully.
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-0e3bcf67-67ee-440e-9dfd-b4f6a7a94094 req-9c7822a6-4d5b-4580-ac76-db8a6e9b6eda service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0e3bcf67-67ee-440e-9dfd-b4f6a7a94094 req-9c7822a6-4d5b-4580-ac76-db8a6e9b6eda service nova] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0e3bcf67-67ee-440e-9dfd-b4f6a7a94094 req-9c7822a6-4d5b-4580-ac76-db8a6e9b6eda service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0e3bcf67-67ee-440e-9dfd-b4f6a7a94094 req-9c7822a6-4d5b-4580-ac76-db8a6e9b6eda service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-0e3bcf67-67ee-440e-9dfd-b4f6a7a94094 req-9c7822a6-4d5b-4580-ac76-db8a6e9b6eda service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] No waiting events found dispatching network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:28:55 user nova-compute[75205]: WARNING nova.compute.manager [req-0e3bcf67-67ee-440e-9dfd-b4f6a7a94094 req-9c7822a6-4d5b-4580-ac76-db8a6e9b6eda service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received unexpected event network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 for instance with vm_state building and task_state spawning.
Nov 14 19:28:55 user nova-compute[75205]: INFO nova.compute.manager [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 14 19:28:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:28:55 user nova-compute[75205]: INFO nova.compute.manager [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Took 5.88 seconds to build instance.
Nov 14 19:28:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5a7b974d-78cc-4833-87ce-f8e67297492a tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "22b41998-e98e-4797-b28d-db091cea8112" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.973s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:28:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:28:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:11 user nova-compute[75205]: INFO nova.compute.manager [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Terminating instance
Nov 14 19:29:11 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b003c5e9-1e94-41d8-b1bf-b03fc7a54e9b req-29ea1856-344b-4aee-a3a2-5df8e3cce077 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-unplugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b003c5e9-1e94-41d8-b1bf-b03fc7a54e9b req-29ea1856-344b-4aee-a3a2-5df8e3cce077 service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b003c5e9-1e94-41d8-b1bf-b03fc7a54e9b req-29ea1856-344b-4aee-a3a2-5df8e3cce077 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b003c5e9-1e94-41d8-b1bf-b03fc7a54e9b req-29ea1856-344b-4aee-a3a2-5df8e3cce077 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b003c5e9-1e94-41d8-b1bf-b03fc7a54e9b req-29ea1856-344b-4aee-a3a2-5df8e3cce077 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-unplugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b003c5e9-1e94-41d8-b1bf-b03fc7a54e9b req-29ea1856-344b-4aee-a3a2-5df8e3cce077 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-unplugged-e2673078-5990-442a-ab11-60a51b39057e for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:29:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Instance destroyed successfully.
Nov 14 19:29:12 user nova-compute[75205]: DEBUG nova.objects.instance [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lazy-loading 'resources' on Instance uuid 41394628-10e9-4adc-8bd5-0eae6cfe1f8a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1510501547',display_name='tempest-ServerRescueNegativeTestJSON-server-1510501547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1510501547',id=16,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:17:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eabb88364cd4173ba71aa8920d40954',ramdisk_id='',reservation_id='r-rl9b6fr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-278369752',owner_user_name='tempest-ServerRescueNegativeTestJSON-278369752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:19:03Z,user_data=None,user_id='1b03af1014734b1a8d4c2633756070e8',uuid=41394628-10e9-4adc-8bd5-0eae6cfe1f8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converting VIF {"id": "e2673078-5990-442a-ab11-60a51b39057e", "address": "fa:16:3e:fe:60:ed", "network": {"id": "90df3cd1-0da6-4802-94c1-12a8ace99974", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1578373435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eabb88364cd4173ba71aa8920d40954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2673078-59", "ovs_interfaceid": "e2673078-5990-442a-ab11-60a51b39057e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=e2673078-5990-442a-ab11-60a51b39057e,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2673078-59') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG os_vif [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=e2673078-5990-442a-ab11-60a51b39057e,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2673078-59') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2673078-59, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=648523ef-8e20-4eff-883b-3c370f0a7bc7) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:29:12 user nova-compute[75205]: INFO os_vif [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=e2673078-5990-442a-ab11-60a51b39057e,network=Network(90df3cd1-0da6-4802-94c1-12a8ace99974),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2673078-59')
Nov 14 19:29:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Deleting instance files /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a_del
Nov 14 19:29:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Deletion of /opt/stack/data/nova/instances/41394628-10e9-4adc-8bd5-0eae6cfe1f8a_del complete
Nov 14 19:29:12 user nova-compute[75205]: INFO nova.compute.manager [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 19:29:12 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:29:12 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Took 0.50 seconds to deallocate network for instance.
Nov 14 19:29:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-f678f23f-2ff9-4fd7-a13f-55f0d139ffa6 req-c1d12a9d-dda9-4252-a204-3600a96b5721 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-deleted-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:29:13 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:29:13 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:29:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:13 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Deleted allocations for instance 41394628-10e9-4adc-8bd5-0eae6cfe1f8a
Nov 14 19:29:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fe268196-1bf2-49ae-978d-59258278325d tempest-ServerRescueNegativeTestJSON-278369752 tempest-ServerRescueNegativeTestJSON-278369752-project-member] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.938s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-3345ba51-3ef6-4f8e-a7ce-4264f75e2842 req-181f8cf7-e2e5-495e-b64d-35f9070a9428 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:29:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3345ba51-3ef6-4f8e-a7ce-4264f75e2842 req-181f8cf7-e2e5-495e-b64d-35f9070a9428 service nova] Acquiring lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3345ba51-3ef6-4f8e-a7ce-4264f75e2842 req-181f8cf7-e2e5-495e-b64d-35f9070a9428 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3345ba51-3ef6-4f8e-a7ce-4264f75e2842 req-181f8cf7-e2e5-495e-b64d-35f9070a9428 service nova] Lock "41394628-10e9-4adc-8bd5-0eae6cfe1f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-3345ba51-3ef6-4f8e-a7ce-4264f75e2842 req-181f8cf7-e2e5-495e-b64d-35f9070a9428 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] No waiting events found dispatching network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:29:13 user nova-compute[75205]: WARNING nova.compute.manager [req-3345ba51-3ef6-4f8e-a7ce-4264f75e2842 req-181f8cf7-e2e5-495e-b64d-35f9070a9428 service nova] [instance: 41394628-10e9-4adc-8bd5-0eae6cfe1f8a] Received unexpected event network-vif-plugged-e2673078-5990-442a-ab11-60a51b39057e for instance with vm_state deleted and task_state None.
Nov 14 19:29:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Acquiring lock "04a4b26b-540f-4748-846f-4da567ab8cc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:18 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:29:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:18 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:29:18 user nova-compute[75205]: INFO nova.compute.claims [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Claim successful on node user
Nov 14 19:29:19 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:29:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:29:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG nova.policy [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0709d4c2361940bca1cf7749ab82349d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689cf0600a644d749771f58f5d6feb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:29:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Creating image(s)
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Acquiring lock "/opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "/opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "/opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:19 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk 1073741824" returned: 0 in 0.050s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Successfully created port: 5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Cannot resize image /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Ensure instance console log exists: /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Successfully updated port: 5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Acquiring lock "refresh_cache-04a4b26b-540f-4748-846f-4da567ab8cc7" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Acquired lock "refresh_cache-04a4b26b-540f-4748-846f-4da567ab8cc7" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-d3fb136e-2eec-400c-a872-91084ec4d05c req-ed4fda14-fa0b-4e88-af9e-23d5887e1595 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Received event network-changed-5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-d3fb136e-2eec-400c-a872-91084ec4d05c req-ed4fda14-fa0b-4e88-af9e-23d5887e1595 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Refreshing instance network info cache due to event network-changed-5f2780e3-a410-4495-8df0-80c87a4ad2c7. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d3fb136e-2eec-400c-a872-91084ec4d05c req-ed4fda14-fa0b-4e88-af9e-23d5887e1595 service nova] Acquiring lock "refresh_cache-04a4b26b-540f-4748-846f-4da567ab8cc7" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:29:20 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.network.neutron [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Updating instance_info_cache with network_info: [{"id": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "address": "fa:16:3e:a7:f1:88", "network": {"id": "c8ee47b0-b338-49f7-be25-8df0a84f3407", "bridge": "br-int", "label": "tempest-VolumesActionsTest-642748005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "689cf0600a644d749771f58f5d6feb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2780e3-a4", "ovs_interfaceid": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Releasing lock "refresh_cache-04a4b26b-540f-4748-846f-4da567ab8cc7" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Instance network_info: |[{"id": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "address": "fa:16:3e:a7:f1:88", "network": {"id": "c8ee47b0-b338-49f7-be25-8df0a84f3407", "bridge": "br-int", "label": "tempest-VolumesActionsTest-642748005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "689cf0600a644d749771f58f5d6feb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2780e3-a4", "ovs_interfaceid": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d3fb136e-2eec-400c-a872-91084ec4d05c req-ed4fda14-fa0b-4e88-af9e-23d5887e1595 service nova] Acquired lock "refresh_cache-04a4b26b-540f-4748-846f-4da567ab8cc7" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-d3fb136e-2eec-400c-a872-91084ec4d05c req-ed4fda14-fa0b-4e88-af9e-23d5887e1595 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Refreshing network info cache for port 5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Start _get_guest_xml network_info=[{"id": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "address": "fa:16:3e:a7:f1:88", "network": {"id": "c8ee47b0-b338-49f7-be25-8df0a84f3407", "bridge": "br-int", "label": "tempest-VolumesActionsTest-642748005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "689cf0600a644d749771f58f5d6feb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2780e3-a4", "ovs_interfaceid": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:29:21 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:29:21 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1552227333',display_name='tempest-VolumesActionsTest-instance-1552227333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1552227333',id=41,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='689cf0600a644d749771f58f5d6feb67',ramdisk_id='',reservation_id='r-rv9x3ut2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1801652857',owner_user_name='tempest-VolumesActionsTest-1801652857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:29:20Z,user_data=None,user_id='0709d4c2361940bca1cf7749ab82349d',uuid=04a4b26b-540f-4748-846f-4da567ab8cc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "address": "fa:16:3e:a7:f1:88", "network": {"id": "c8ee47b0-b338-49f7-be25-8df0a84f3407", "bridge": "br-int", "label": "tempest-VolumesActionsTest-642748005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "689cf0600a644d749771f58f5d6feb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2780e3-a4", "ovs_interfaceid": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Converting VIF {"id": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "address": "fa:16:3e:a7:f1:88", "network": {"id": "c8ee47b0-b338-49f7-be25-8df0a84f3407", "bridge": "br-int", "label": "tempest-VolumesActionsTest-642748005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "689cf0600a644d749771f58f5d6feb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2780e3-a4", "ovs_interfaceid": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:88,bridge_name='br-int',has_traffic_filtering=True,id=5f2780e3-a410-4495-8df0-80c87a4ad2c7,network=Network(c8ee47b0-b338-49f7-be25-8df0a84f3407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2780e3-a4') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lazy-loading 'pci_devices' on Instance uuid 04a4b26b-540f-4748-846f-4da567ab8cc7 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:29:21 user nova-compute[75205]:   <uuid>04a4b26b-540f-4748-846f-4da567ab8cc7</uuid>
Nov 14 19:29:21 user nova-compute[75205]:   <name>instance-00000029</name>
Nov 14 19:29:21 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:29:21 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:29:21 user nova-compute[75205]:   <metadata>
Nov 14 19:29:21 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:29:21 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:29:21 user nova-compute[75205]:       <nova:name>tempest-VolumesActionsTest-instance-1552227333</nova:name>
Nov 14 19:29:21 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:29:21</nova:creationTime>
Nov 14 19:29:21 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:29:21 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:29:21 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:29:21 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:29:21 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:29:21 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:29:21 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:29:21 user nova-compute[75205]:       <nova:owner>
Nov 14 19:29:21 user nova-compute[75205]:         <nova:user uuid="0709d4c2361940bca1cf7749ab82349d">tempest-VolumesActionsTest-1801652857-project-member</nova:user>
Nov 14 19:29:21 user nova-compute[75205]:         <nova:project uuid="689cf0600a644d749771f58f5d6feb67">tempest-VolumesActionsTest-1801652857</nova:project>
Nov 14 19:29:21 user nova-compute[75205]:       </nova:owner>
Nov 14 19:29:21 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:29:21 user nova-compute[75205]:       <nova:ports>
Nov 14 19:29:21 user nova-compute[75205]:         <nova:port uuid="5f2780e3-a410-4495-8df0-80c87a4ad2c7">
Nov 14 19:29:21 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 19:29:21 user nova-compute[75205]:         </nova:port>
Nov 14 19:29:21 user nova-compute[75205]:       </nova:ports>
Nov 14 19:29:21 user nova-compute[75205]:     </nova:instance>
Nov 14 19:29:21 user nova-compute[75205]:   </metadata>
Nov 14 19:29:21 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:29:21 user nova-compute[75205]:     <system>
Nov 14 19:29:21 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:29:21 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:29:21 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:29:21 user nova-compute[75205]:       <entry name="serial">04a4b26b-540f-4748-846f-4da567ab8cc7</entry>
Nov 14 19:29:21 user nova-compute[75205]:       <entry name="uuid">04a4b26b-540f-4748-846f-4da567ab8cc7</entry>
Nov 14 19:29:21 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:29:21 user nova-compute[75205]:     </system>
Nov 14 19:29:21 user nova-compute[75205]:   </sysinfo>
Nov 14 19:29:21 user nova-compute[75205]:   <os>
Nov 14 19:29:21 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:29:21 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:29:21 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:29:21 user nova-compute[75205]:   </os>
Nov 14 19:29:21 user nova-compute[75205]:   <features>
Nov 14 19:29:21 user nova-compute[75205]:     <acpi/>
Nov 14 19:29:21 user nova-compute[75205]:     <apic/>
Nov 14 19:29:21 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:29:21 user nova-compute[75205]:   </features>
Nov 14 19:29:21 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:29:21 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:29:21 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:29:21 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:29:21 user nova-compute[75205]:   </clock>
Nov 14 19:29:21 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:29:21 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:29:21 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:29:21 user nova-compute[75205]:   </cpu>
Nov 14 19:29:21 user nova-compute[75205]:   <devices>
Nov 14 19:29:21 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:29:21 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:29:21 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk"/>
Nov 14 19:29:21 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:29:21 user nova-compute[75205]:     </disk>
Nov 14 19:29:21 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:29:21 user nova-compute[75205]:       <mac address="fa:16:3e:a7:f1:88"/>
Nov 14 19:29:21 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:29:21 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:29:21 user nova-compute[75205]:       <target dev="tap5f2780e3-a4"/>
Nov 14 19:29:21 user nova-compute[75205]:     </interface>
Nov 14 19:29:21 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:29:21 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/console.log" append="off"/>
Nov 14 19:29:21 user nova-compute[75205]:     </serial>
Nov 14 19:29:21 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:29:21 user nova-compute[75205]:     <video>
Nov 14 19:29:21 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:29:21 user nova-compute[75205]:     </video>
Nov 14 19:29:21 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:29:21 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:29:21 user nova-compute[75205]:     </rng>
Nov 14 19:29:21 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:29:21 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:29:21 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:29:21 user nova-compute[75205]:     </memballoon>
Nov 14 19:29:21 user nova-compute[75205]:   </devices>
Nov 14 19:29:21 user nova-compute[75205]: </domain>
Nov 14 19:29:21 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1552227333',display_name='tempest-VolumesActionsTest-instance-1552227333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1552227333',id=41,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='689cf0600a644d749771f58f5d6feb67',ramdisk_id='',reservation_id='r-rv9x3ut2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1801652857',owner_user_name='tempest-VolumesActionsTest-1801652857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:29:20Z,user_data=None,user_id='0709d4c2361940bca1cf7749ab82349d',uuid=04a4b26b-540f-4748-846f-4da567ab8cc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "address": "fa:16:3e:a7:f1:88", "network": {"id": "c8ee47b0-b338-49f7-be25-8df0a84f3407", "bridge": "br-int", "label": "tempest-VolumesActionsTest-642748005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "689cf0600a644d749771f58f5d6feb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2780e3-a4", "ovs_interfaceid": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Converting VIF {"id": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "address": "fa:16:3e:a7:f1:88", "network": {"id": "c8ee47b0-b338-49f7-be25-8df0a84f3407", "bridge": "br-int", "label": "tempest-VolumesActionsTest-642748005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "689cf0600a644d749771f58f5d6feb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2780e3-a4", "ovs_interfaceid": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:88,bridge_name='br-int',has_traffic_filtering=True,id=5f2780e3-a410-4495-8df0-80c87a4ad2c7,network=Network(c8ee47b0-b338-49f7-be25-8df0a84f3407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2780e3-a4') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG os_vif [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:88,bridge_name='br-int',has_traffic_filtering=True,id=5f2780e3-a410-4495-8df0-80c87a4ad2c7,network=Network(c8ee47b0-b338-49f7-be25-8df0a84f3407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2780e3-a4') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcd243d7-0890-5144-a42c-cb8b9f0317b1', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f2780e3-a4, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f2780e3-a4, col_values=(('qos', UUID('03b60338-da32-4aca-b835-c62ea39cda6f')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f2780e3-a4, col_values=(('external_ids', {'iface-id': '5f2780e3-a410-4495-8df0-80c87a4ad2c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:f1:88', 'vm-uuid': '04a4b26b-540f-4748-846f-4da567ab8cc7'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:21 user nova-compute[75205]: INFO os_vif [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:88,bridge_name='br-int',has_traffic_filtering=True,id=5f2780e3-a410-4495-8df0-80c87a4ad2c7,network=Network(c8ee47b0-b338-49f7-be25-8df0a84f3407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2780e3-a4')
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] No VIF found with MAC fa:16:3e:a7:f1:88, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-d3fb136e-2eec-400c-a872-91084ec4d05c req-ed4fda14-fa0b-4e88-af9e-23d5887e1595 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Updated VIF entry in instance network info cache for port 5f2780e3-a410-4495-8df0-80c87a4ad2c7. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG nova.network.neutron [req-d3fb136e-2eec-400c-a872-91084ec4d05c req-ed4fda14-fa0b-4e88-af9e-23d5887e1595 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Updating instance_info_cache with network_info: [{"id": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "address": "fa:16:3e:a7:f1:88", "network": {"id": "c8ee47b0-b338-49f7-be25-8df0a84f3407", "bridge": "br-int", "label": "tempest-VolumesActionsTest-642748005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "689cf0600a644d749771f58f5d6feb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2780e3-a4", "ovs_interfaceid": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:29:21 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d3fb136e-2eec-400c-a872-91084ec4d05c req-ed4fda14-fa0b-4e88-af9e-23d5887e1595 service nova] Releasing lock "refresh_cache-04a4b26b-540f-4748-846f-4da567ab8cc7" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:29:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-4ec064fd-905f-4bd5-91f5-2aa83a851cff req-aa24103a-fd8f-4c3e-9ee1-d329a0cb4a26 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Received event network-vif-plugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:29:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4ec064fd-905f-4bd5-91f5-2aa83a851cff req-aa24103a-fd8f-4c3e-9ee1-d329a0cb4a26 service nova] Acquiring lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4ec064fd-905f-4bd5-91f5-2aa83a851cff req-aa24103a-fd8f-4c3e-9ee1-d329a0cb4a26 service nova] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4ec064fd-905f-4bd5-91f5-2aa83a851cff req-aa24103a-fd8f-4c3e-9ee1-d329a0cb4a26 service nova] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:23 user nova-compute[75205]: DEBUG nova.compute.manager [req-4ec064fd-905f-4bd5-91f5-2aa83a851cff req-aa24103a-fd8f-4c3e-9ee1-d329a0cb4a26 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] No waiting events found dispatching network-vif-plugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:29:23 user nova-compute[75205]: WARNING nova.compute.manager [req-4ec064fd-905f-4bd5-91f5-2aa83a851cff req-aa24103a-fd8f-4c3e-9ee1-d329a0cb4a26 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Received unexpected event network-vif-plugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 for instance with vm_state building and task_state spawning.
Nov 14 19:29:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:24 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:29:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:29:24 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Instance spawned successfully.
Nov 14 19:29:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:29:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:29:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:29:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:29:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:29:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:29:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:29:24 user nova-compute[75205]: INFO nova.compute.manager [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 14 19:29:24 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:29:25 user nova-compute[75205]: INFO nova.compute.manager [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Took 6.11 seconds to build instance.
Nov 14 19:29:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ebb2ebda-98fe-489b-9092-1928ff0a6ca3 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.207s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-9b4b9ba7-9a4a-41c1-9cdf-0990426ffe27 req-d89bd0db-fb8e-4950-a9ef-53212abd6d2a service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Received event network-vif-plugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:29:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9b4b9ba7-9a4a-41c1-9cdf-0990426ffe27 req-d89bd0db-fb8e-4950-a9ef-53212abd6d2a service nova] Acquiring lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9b4b9ba7-9a4a-41c1-9cdf-0990426ffe27 req-d89bd0db-fb8e-4950-a9ef-53212abd6d2a service nova] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9b4b9ba7-9a4a-41c1-9cdf-0990426ffe27 req-d89bd0db-fb8e-4950-a9ef-53212abd6d2a service nova] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-9b4b9ba7-9a4a-41c1-9cdf-0990426ffe27 req-d89bd0db-fb8e-4950-a9ef-53212abd6d2a service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] No waiting events found dispatching network-vif-plugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:29:25 user nova-compute[75205]: WARNING nova.compute.manager [req-9b4b9ba7-9a4a-41c1-9cdf-0990426ffe27 req-d89bd0db-fb8e-4950-a9ef-53212abd6d2a service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Received unexpected event network-vif-plugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 for instance with vm_state active and task_state None.
Nov 14 19:29:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:34 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:29:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:29:40 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:29:40 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=7952MB free_disk=25.15994644165039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Applying migration context for instance 298a5eb2-6362-40bd-93fa-2cad9b07718a as it has an incoming, in-progress migration f47fa527-9ad7-4f1a-8041-7f47f67d3c8d. Migration status is finished {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 19:29:40 user nova-compute[75205]: INFO nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating resource usage from migration f47fa527-9ad7-4f1a-8041-7f47f67d3c8d
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7260ad81-fc37-4726-8fee-9adecb58040f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 602429d1-cfd8-4984-97db-b086f9d1ecfd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Migration f47fa527-9ad7-4f1a-8041-7f47f67d3c8d is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 298a5eb2-6362-40bd-93fa-2cad9b07718a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 22b41998-e98e-4797-b28d-db091cea8112 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 04a4b26b-540f-4748-846f-4da567ab8cc7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:29:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:29:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:29:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:29:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:43 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:45 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-cd81fb46-f64c-480b-be65-298019f16f7b req-317a1c39-6865-4d90-a230-b1fe46beb6a8 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-changed-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:29:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-cd81fb46-f64c-480b-be65-298019f16f7b req-317a1c39-6865-4d90-a230-b1fe46beb6a8 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Refreshing instance network info cache due to event network-changed-85389b0d-a54a-48df-b551-f057e727cb4f. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:29:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cd81fb46-f64c-480b-be65-298019f16f7b req-317a1c39-6865-4d90-a230-b1fe46beb6a8 service nova] Acquiring lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:29:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cd81fb46-f64c-480b-be65-298019f16f7b req-317a1c39-6865-4d90-a230-b1fe46beb6a8 service nova] Acquired lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:29:45 user nova-compute[75205]: DEBUG nova.network.neutron [req-cd81fb46-f64c-480b-be65-298019f16f7b req-317a1c39-6865-4d90-a230-b1fe46beb6a8 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Refreshing network info cache for port 85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:29:45 user nova-compute[75205]: DEBUG nova.network.neutron [req-cd81fb46-f64c-480b-be65-298019f16f7b req-317a1c39-6865-4d90-a230-b1fe46beb6a8 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Updated VIF entry in instance network info cache for port 85389b0d-a54a-48df-b551-f057e727cb4f. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:29:45 user nova-compute[75205]: DEBUG nova.network.neutron [req-cd81fb46-f64c-480b-be65-298019f16f7b req-317a1c39-6865-4d90-a230-b1fe46beb6a8 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Updating instance_info_cache with network_info: [{"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:29:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cd81fb46-f64c-480b-be65-298019f16f7b req-317a1c39-6865-4d90-a230-b1fe46beb6a8 service nova] Releasing lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:29:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:49 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75205) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 19:29:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "8abc2e08-6973-4bed-93a6-4a33255201a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:29:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:49 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:29:49 user nova-compute[75205]: INFO nova.compute.claims [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Claim successful on node user
Nov 14 19:29:50 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:29:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:29:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:29:50 user nova-compute[75205]: INFO nova.virt.block_device [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Booting with volume 5fbeb5ca-35d2-43c8-bf20-c57accce411b at /dev/vda
Nov 14 19:29:50 user nova-compute[75205]: DEBUG nova.policy [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06b3b7a0f2ae441f8cb1d50891fcab94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fe039dc34949509e4ad72cd9da3bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG os_brick.utils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aaef80-b22c-47d0-a62e-19d33c6447a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39ed670-80ba-4464-84f5-767299685f0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af6eb04-b9ae-49a1-8b95-8a4e3b941087]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf0883-5e77-45cc-adb8-e6156859ff91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:29:50 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:29:50 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd9ad39-b1db-42aa-b37a-96d0dd6d36f8]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG os_brick.utils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:29:50 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Updating existing volume attachment record: d279b696-cfd6-4e26-aacb-7e1d4bf6348c {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Successfully created port: 1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] There are 0 instances to clean {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Successfully updated port: 1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquired lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-4b7923b0-dd7e-4994-8b97-063c64217dc9 req-dadfccc4-98a4-430c-9e81-5ddc69bf3ca3 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received event network-changed-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-4b7923b0-dd7e-4994-8b97-063c64217dc9 req-dadfccc4-98a4-430c-9e81-5ddc69bf3ca3 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Refreshing instance network info cache due to event network-changed-1d944d4e-ebee-4cae-8448-0b7f00ac89f6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4b7923b0-dd7e-4994-8b97-063c64217dc9 req-dadfccc4-98a4-430c-9e81-5ddc69bf3ca3 service nova] Acquiring lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:29:51 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Updating instance_info_cache with network_info: [{"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:29:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Releasing lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:29:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Instance network_info: |[{"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:29:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4b7923b0-dd7e-4994-8b97-063c64217dc9 req-dadfccc4-98a4-430c-9e81-5ddc69bf3ca3 service nova] Acquired lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:29:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-4b7923b0-dd7e-4994-8b97-063c64217dc9 req-dadfccc4-98a4-430c-9e81-5ddc69bf3ca3 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Refreshing network info cache for port 1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:29:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-4b7923b0-dd7e-4994-8b97-063c64217dc9 req-dadfccc4-98a4-430c-9e81-5ddc69bf3ca3 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Updated VIF entry in instance network info cache for port 1d944d4e-ebee-4cae-8448-0b7f00ac89f6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:29:52 user nova-compute[75205]: DEBUG nova.network.neutron [req-4b7923b0-dd7e-4994-8b97-063c64217dc9 req-dadfccc4-98a4-430c-9e81-5ddc69bf3ca3 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Updating instance_info_cache with network_info: [{"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:29:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4b7923b0-dd7e-4994-8b97-063c64217dc9 req-dadfccc4-98a4-430c-9e81-5ddc69bf3ca3 service nova] Releasing lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:29:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Creating image(s)
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Did not create local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Ensure instance console log exists: /opt/stack/data/nova/instances/8abc2e08-6973-4bed-93a6-4a33255201a2/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Start _get_guest_xml network_info=[{"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PATlspQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8abc2e08-6973-4bed-93a6-4a33255201a2', 'attached_at': '', 'detached_at': '', 'volume_id': '5fbeb5ca-35d2-43c8-bf20-c57accce411b', 'serial': '5fbeb5ca-35d2-43c8-bf20-c57accce411b'}, 'attachment_id': 'd279b696-cfd6-4e26-aacb-7e1d4bf6348c', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:29:55 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:29:55 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PATlspQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:29:55 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:29:55 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:29:55 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[42de49a7-8f76-4aa4-9bbc-fa06ec2d5b63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:29:55 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f697cd29-cf24-43f8-b247-ddfb205f91f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b] added
Nov 14 19:29:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[65992373-739b-4256-bda1-f8f965b9f8a5]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0e77e0-4149-4bbb-99c8-331e922dddf6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PATlspQO {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PATlspQO" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddec007-d409-43d9-91ed-bda527035068]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PATlspQO'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[da70b486-e306-4255-a0ee-412b5d840132]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d93a4-c99b-4cb3-8cf8-86c8f7663306]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:29:55 user nova-compute[75205]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:29:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:29:55 user nova-compute[75205]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:29:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a56d0-5d29-44e0-9e5e-96cc0ace7ab3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b, portal: 172.16.0.220,3260]
Nov 14 19:29:55 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b, portal: 172.16.0.220,3260] successful.
Nov 14 19:29:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecee798-cde5-442c-9d18-e7413ab2e4b4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd2cd40-7d09-4630-8af1-3c8f4886644a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:29:55 user nova-compute[75205]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:29:55 user nova-compute[75205]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b (non-flash)
Nov 14 19:29:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:29:55 user nova-compute[75205]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:29:55 user nova-compute[75205]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b (non-flash)
Nov 14 19:29:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[20320191-b087-4650-94e0-f87889611bc5]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:29:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PATlspQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26265646662646534', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265646662646534', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1800687263',display_name='tempest-TestVolumeBootPattern-server-1800687263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1800687263',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4lflwSUeyVbH81QiQ0Uh3cKzramHeRM7aduqUtZ4pb3+SjiUT5tItPthN7NGlihkCZ2OzXolgwmiBolVRT+jaN4ru1XGIc7ZtqCPOyOWGe8i2eYeT/Jps/FMv13SMF/w==',key_name='tempest-TestVolumeBootPattern-186737572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-0n3qaosb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:29:50Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=8abc2e08-6973-4bed-93a6-4a33255201a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a3:a4,bridge_name='br-int',has_traffic_filtering=True,id=1d944d4e-ebee-4cae-8448-0b7f00ac89f6,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d944d4e-eb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'pci_devices' on Instance uuid 8abc2e08-6973-4bed-93a6-4a33255201a2 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:29:56 user nova-compute[75205]:   <uuid>8abc2e08-6973-4bed-93a6-4a33255201a2</uuid>
Nov 14 19:29:56 user nova-compute[75205]:   <name>instance-0000002a</name>
Nov 14 19:29:56 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:29:56 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:29:56 user nova-compute[75205]:   <metadata>
Nov 14 19:29:56 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:29:56 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:29:56 user nova-compute[75205]:       <nova:name>tempest-TestVolumeBootPattern-server-1800687263</nova:name>
Nov 14 19:29:56 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:29:55</nova:creationTime>
Nov 14 19:29:56 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:29:56 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:29:56 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:29:56 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:29:56 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:29:56 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:29:56 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:29:56 user nova-compute[75205]:       <nova:owner>
Nov 14 19:29:56 user nova-compute[75205]:         <nova:user uuid="06b3b7a0f2ae441f8cb1d50891fcab94">tempest-TestVolumeBootPattern-397278786-project-member</nova:user>
Nov 14 19:29:56 user nova-compute[75205]:         <nova:project uuid="e2fe039dc34949509e4ad72cd9da3bf1">tempest-TestVolumeBootPattern-397278786</nova:project>
Nov 14 19:29:56 user nova-compute[75205]:       </nova:owner>
Nov 14 19:29:56 user nova-compute[75205]:       <nova:ports>
Nov 14 19:29:56 user nova-compute[75205]:         <nova:port uuid="1d944d4e-ebee-4cae-8448-0b7f00ac89f6">
Nov 14 19:29:56 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 19:29:56 user nova-compute[75205]:         </nova:port>
Nov 14 19:29:56 user nova-compute[75205]:       </nova:ports>
Nov 14 19:29:56 user nova-compute[75205]:     </nova:instance>
Nov 14 19:29:56 user nova-compute[75205]:   </metadata>
Nov 14 19:29:56 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:29:56 user nova-compute[75205]:     <system>
Nov 14 19:29:56 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:29:56 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:29:56 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:29:56 user nova-compute[75205]:       <entry name="serial">8abc2e08-6973-4bed-93a6-4a33255201a2</entry>
Nov 14 19:29:56 user nova-compute[75205]:       <entry name="uuid">8abc2e08-6973-4bed-93a6-4a33255201a2</entry>
Nov 14 19:29:56 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:29:56 user nova-compute[75205]:     </system>
Nov 14 19:29:56 user nova-compute[75205]:   </sysinfo>
Nov 14 19:29:56 user nova-compute[75205]:   <os>
Nov 14 19:29:56 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:29:56 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:29:56 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:29:56 user nova-compute[75205]:   </os>
Nov 14 19:29:56 user nova-compute[75205]:   <features>
Nov 14 19:29:56 user nova-compute[75205]:     <acpi/>
Nov 14 19:29:56 user nova-compute[75205]:     <apic/>
Nov 14 19:29:56 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:29:56 user nova-compute[75205]:   </features>
Nov 14 19:29:56 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:29:56 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:29:56 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:29:56 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:29:56 user nova-compute[75205]:   </clock>
Nov 14 19:29:56 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:29:56 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:29:56 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:29:56 user nova-compute[75205]:   </cpu>
Nov 14 19:29:56 user nova-compute[75205]:   <devices>
Nov 14 19:29:56 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:29:56 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:29:56 user nova-compute[75205]:       <source dev="/dev/sdd"/>
Nov 14 19:29:56 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:29:56 user nova-compute[75205]:       <serial>5fbeb5ca-35d2-43c8-bf20-c57accce411b</serial>
Nov 14 19:29:56 user nova-compute[75205]:     </disk>
Nov 14 19:29:56 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:29:56 user nova-compute[75205]:       <mac address="fa:16:3e:7f:a3:a4"/>
Nov 14 19:29:56 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:29:56 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:29:56 user nova-compute[75205]:       <target dev="tap1d944d4e-eb"/>
Nov 14 19:29:56 user nova-compute[75205]:     </interface>
Nov 14 19:29:56 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:29:56 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/8abc2e08-6973-4bed-93a6-4a33255201a2/console.log" append="off"/>
Nov 14 19:29:56 user nova-compute[75205]:     </serial>
Nov 14 19:29:56 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:29:56 user nova-compute[75205]:     <video>
Nov 14 19:29:56 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:29:56 user nova-compute[75205]:     </video>
Nov 14 19:29:56 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:29:56 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:29:56 user nova-compute[75205]:     </rng>
Nov 14 19:29:56 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:29:56 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:29:56 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:29:56 user nova-compute[75205]:     </memballoon>
Nov 14 19:29:56 user nova-compute[75205]:   </devices>
Nov 14 19:29:56 user nova-compute[75205]: </domain>
Nov 14 19:29:56 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1800687263',display_name='tempest-TestVolumeBootPattern-server-1800687263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1800687263',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4lflwSUeyVbH81QiQ0Uh3cKzramHeRM7aduqUtZ4pb3+SjiUT5tItPthN7NGlihkCZ2OzXolgwmiBolVRT+jaN4ru1XGIc7ZtqCPOyOWGe8i2eYeT/Jps/FMv13SMF/w==',key_name='tempest-TestVolumeBootPattern-186737572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-0n3qaosb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:29:50Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=8abc2e08-6973-4bed-93a6-4a33255201a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a3:a4,bridge_name='br-int',has_traffic_filtering=True,id=1d944d4e-ebee-4cae-8448-0b7f00ac89f6,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d944d4e-eb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG os_vif [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a3:a4,bridge_name='br-int',has_traffic_filtering=True,id=1d944d4e-ebee-4cae-8448-0b7f00ac89f6,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d944d4e-eb') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05cbfca0-4dba-55a5-8166-0d7531b84fc2', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d944d4e-eb, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d944d4e-eb, col_values=(('qos', UUID('393469c3-d09c-4e01-9f2f-7d0885ae09bf')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d944d4e-eb, col_values=(('external_ids', {'iface-id': '1d944d4e-ebee-4cae-8448-0b7f00ac89f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:a3:a4', 'vm-uuid': '8abc2e08-6973-4bed-93a6-4a33255201a2'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:56 user nova-compute[75205]: INFO os_vif [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a3:a4,bridge_name='br-int',has_traffic_filtering=True,id=1d944d4e-ebee-4cae-8448-0b7f00ac89f6,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d944d4e-eb')
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:29:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] No VIF found with MAC fa:16:3e:7f:a3:a4, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:29:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-e0704c24-11ae-406d-9b2a-fa8e1d4ba7b0 req-7e107c43-3e96-466c-9dc6-d94f14629b34 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received event network-vif-plugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:29:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e0704c24-11ae-406d-9b2a-fa8e1d4ba7b0 req-7e107c43-3e96-466c-9dc6-d94f14629b34 service nova] Acquiring lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e0704c24-11ae-406d-9b2a-fa8e1d4ba7b0 req-7e107c43-3e96-466c-9dc6-d94f14629b34 service nova] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e0704c24-11ae-406d-9b2a-fa8e1d4ba7b0 req-7e107c43-3e96-466c-9dc6-d94f14629b34 service nova] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:29:58 user nova-compute[75205]: DEBUG nova.compute.manager [req-e0704c24-11ae-406d-9b2a-fa8e1d4ba7b0 req-7e107c43-3e96-466c-9dc6-d94f14629b34 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] No waiting events found dispatching network-vif-plugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:29:58 user nova-compute[75205]: WARNING nova.compute.manager [req-e0704c24-11ae-406d-9b2a-fa8e1d4ba7b0 req-7e107c43-3e96-466c-9dc6-d94f14629b34 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received unexpected event network-vif-plugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 for instance with vm_state building and task_state spawning.
Nov 14 19:29:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Going to confirm migration 2 {{(pid=75205) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquired lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG nova.network.neutron [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG nova.objects.instance [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'info_cache' on Instance uuid 298a5eb2-6362-40bd-93fa-2cad9b07718a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG nova.network.neutron [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating instance_info_cache with network_info: [{"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Releasing lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG nova.objects.instance [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'migration_context' on Instance uuid 298a5eb2-6362-40bd-93fa-2cad9b07718a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG nova.objects.base [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Object Instance<298a5eb2-6362-40bd-93fa-2cad9b07718a> lazy-loaded attributes: info_cache,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:29:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:30:00 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Instance spawned successfully.
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:00 user nova-compute[75205]: INFO nova.compute.manager [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-3c0dc0a9-7fe9-486c-bdbe-c01f7fce7f48 req-16105e49-c456-4b32-81d2-fe40081b2d05 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received event network-vif-plugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3c0dc0a9-7fe9-486c-bdbe-c01f7fce7f48 req-16105e49-c456-4b32-81d2-fe40081b2d05 service nova] Acquiring lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3c0dc0a9-7fe9-486c-bdbe-c01f7fce7f48 req-16105e49-c456-4b32-81d2-fe40081b2d05 service nova] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3c0dc0a9-7fe9-486c-bdbe-c01f7fce7f48 req-16105e49-c456-4b32-81d2-fe40081b2d05 service nova] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-3c0dc0a9-7fe9-486c-bdbe-c01f7fce7f48 req-16105e49-c456-4b32-81d2-fe40081b2d05 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] No waiting events found dispatching network-vif-plugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:30:00 user nova-compute[75205]: WARNING nova.compute.manager [req-3c0dc0a9-7fe9-486c-bdbe-c01f7fce7f48 req-16105e49-c456-4b32-81d2-fe40081b2d05 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received unexpected event network-vif-plugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 for instance with vm_state building and task_state spawning.
Nov 14 19:30:00 user nova-compute[75205]: INFO nova.compute.manager [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Took 10.36 seconds to build instance.
Nov 14 19:30:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b10f7095-9670-4542-ab7f-643d2ff4e52e tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.458s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:30:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.388s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:00 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Deleted allocation for migration f47fa527-9ad7-4f1a-8041-7f47f67d3c8d
Nov 14 19:30:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-39d32add-41dd-48e4-ae26-0e164d108ee7 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.284s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:30:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:30:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:30:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:30:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:36 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:30:36 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:30:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:30:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Acquiring lock "1c22d069-fa97-4996-8649-a81d988f6b04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "1c22d069-fa97-4996-8649-a81d988f6b04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:30:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:38 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:30:38 user nova-compute[75205]: INFO nova.compute.claims [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Claim successful on node user
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Refreshing inventories for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Updating ProviderTree inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Refreshing aggregate associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, aggregates: None {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Refreshing trait associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, traits: HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.network.neutron [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:30:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.policy [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68c823d07b2f4e4e9c640733ad31bc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772fcf8ca41e40dba8aca19cb84fae02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:30:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Creating image(s)
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "/opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "/opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk 1073741824" returned: 0 in 0.049s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG nova.network.neutron [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Successfully created port: 7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Cannot resize image /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Ensure instance console log exists: /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-c528ab75-1579-4daf-b65f-30e5b587a718 req-1ec9b9e9-50e1-41a4-9b61-02e4a6c17be8 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-changed-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-c528ab75-1579-4daf-b65f-30e5b587a718 req-1ec9b9e9-50e1-41a4-9b61-02e4a6c17be8 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Refreshing instance network info cache due to event network-changed-59acb1f8-f517-493d-bab2-257903a6a353. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c528ab75-1579-4daf-b65f-30e5b587a718 req-1ec9b9e9-50e1-41a4-9b61-02e4a6c17be8 service nova] Acquiring lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c528ab75-1579-4daf-b65f-30e5b587a718 req-1ec9b9e9-50e1-41a4-9b61-02e4a6c17be8 service nova] Acquired lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG nova.network.neutron [req-c528ab75-1579-4daf-b65f-30e5b587a718 req-1ec9b9e9-50e1-41a4-9b61-02e4a6c17be8 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Refreshing network info cache for port 59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG nova.network.neutron [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Successfully updated port: 7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:30:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Acquiring lock "refresh_cache-1c22d069-fa97-4996-8649-a81d988f6b04" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Acquired lock "refresh_cache-1c22d069-fa97-4996-8649-a81d988f6b04" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-eafbaa4e-7063-4439-a4a0-dd76553dc2d1 req-8f1f47a3-7f8e-4809-b6c1-8984994d0ca5 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Received event network-changed-7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-eafbaa4e-7063-4439-a4a0-dd76553dc2d1 req-8f1f47a3-7f8e-4809-b6c1-8984994d0ca5 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Refreshing instance network info cache due to event network-changed-7eaa559b-6119-4ef5-b0f4-8e108099d682. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eafbaa4e-7063-4439-a4a0-dd76553dc2d1 req-8f1f47a3-7f8e-4809-b6c1-8984994d0ca5 service nova] Acquiring lock "refresh_cache-1c22d069-fa97-4996-8649-a81d988f6b04" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.network.neutron [req-c528ab75-1579-4daf-b65f-30e5b587a718 req-1ec9b9e9-50e1-41a4-9b61-02e4a6c17be8 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updated VIF entry in instance network info cache for port 59acb1f8-f517-493d-bab2-257903a6a353. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.network.neutron [req-c528ab75-1579-4daf-b65f-30e5b587a718 req-1ec9b9e9-50e1-41a4-9b61-02e4a6c17be8 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updating instance_info_cache with network_info: [{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:30:41 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:30:41 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8009MB free_disk=25.154300689697266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-c528ab75-1579-4daf-b65f-30e5b587a718 req-1ec9b9e9-50e1-41a4-9b61-02e4a6c17be8 service nova] Releasing lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Updating instance_info_cache with network_info: [{"id": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "address": "fa:16:3e:89:19:fa", "network": {"id": "649a39b9-64ae-4eee-b59a-f31c4bd805bf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7d3978d4ce0a499fa185e937ee9bde95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eaa559b-61", "ovs_interfaceid": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Releasing lock "refresh_cache-1c22d069-fa97-4996-8649-a81d988f6b04" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Instance network_info: |[{"id": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "address": "fa:16:3e:89:19:fa", "network": {"id": "649a39b9-64ae-4eee-b59a-f31c4bd805bf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7d3978d4ce0a499fa185e937ee9bde95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eaa559b-61", "ovs_interfaceid": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eafbaa4e-7063-4439-a4a0-dd76553dc2d1 req-8f1f47a3-7f8e-4809-b6c1-8984994d0ca5 service nova] Acquired lock "refresh_cache-1c22d069-fa97-4996-8649-a81d988f6b04" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.network.neutron [req-eafbaa4e-7063-4439-a4a0-dd76553dc2d1 req-8f1f47a3-7f8e-4809-b6c1-8984994d0ca5 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Refreshing network info cache for port 7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Start _get_guest_xml network_info=[{"id": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "address": "fa:16:3e:89:19:fa", "network": {"id": "649a39b9-64ae-4eee-b59a-f31c4bd805bf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7d3978d4ce0a499fa185e937ee9bde95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eaa559b-61", "ovs_interfaceid": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:30:41 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:30:41 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7260ad81-fc37-4726-8fee-9adecb58040f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 602429d1-cfd8-4984-97db-b086f9d1ecfd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 298a5eb2-6362-40bd-93fa-2cad9b07718a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 22b41998-e98e-4797-b28d-db091cea8112 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 04a4b26b-540f-4748-846f-4da567ab8cc7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 8abc2e08-6973-4bed-93a6-4a33255201a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1c22d069-fa97-4996-8649-a81d988f6b04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1418004782',display_name='tempest-VolumesNegativeTest-instance-1418004782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1418004782',id=43,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772fcf8ca41e40dba8aca19cb84fae02',ramdisk_id='',reservation_id='r-3zshqqdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1287488018',owner_user_name='tempest-VolumesNegativeTest-1287488018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:30:40Z,user_data=None,user_id='68c823d07b2f4e4e9c640733ad31bc0e',uuid=1c22d069-fa97-4996-8649-a81d988f6b04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "address": "fa:16:3e:89:19:fa", "network": {"id": "649a39b9-64ae-4eee-b59a-f31c4bd805bf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7d3978d4ce0a499fa185e937ee9bde95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eaa559b-61", "ovs_interfaceid": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Converting VIF {"id": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "address": "fa:16:3e:89:19:fa", "network": {"id": "649a39b9-64ae-4eee-b59a-f31c4bd805bf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7d3978d4ce0a499fa185e937ee9bde95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eaa559b-61", "ovs_interfaceid": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:fa,bridge_name='br-int',has_traffic_filtering=True,id=7eaa559b-6119-4ef5-b0f4-8e108099d682,network=Network(649a39b9-64ae-4eee-b59a-f31c4bd805bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eaa559b-61') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.objects.instance [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c22d069-fa97-4996-8649-a81d988f6b04 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:30:41 user nova-compute[75205]:   <uuid>1c22d069-fa97-4996-8649-a81d988f6b04</uuid>
Nov 14 19:30:41 user nova-compute[75205]:   <name>instance-0000002b</name>
Nov 14 19:30:41 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:30:41 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:30:41 user nova-compute[75205]:   <metadata>
Nov 14 19:30:41 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:30:41 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:30:41 user nova-compute[75205]:       <nova:name>tempest-VolumesNegativeTest-instance-1418004782</nova:name>
Nov 14 19:30:41 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:30:41</nova:creationTime>
Nov 14 19:30:41 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:30:41 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:30:41 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:30:41 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:30:41 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:30:41 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:30:41 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:30:41 user nova-compute[75205]:       <nova:owner>
Nov 14 19:30:41 user nova-compute[75205]:         <nova:user uuid="68c823d07b2f4e4e9c640733ad31bc0e">tempest-VolumesNegativeTest-1287488018-project-member</nova:user>
Nov 14 19:30:41 user nova-compute[75205]:         <nova:project uuid="772fcf8ca41e40dba8aca19cb84fae02">tempest-VolumesNegativeTest-1287488018</nova:project>
Nov 14 19:30:41 user nova-compute[75205]:       </nova:owner>
Nov 14 19:30:41 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:30:41 user nova-compute[75205]:       <nova:ports>
Nov 14 19:30:41 user nova-compute[75205]:         <nova:port uuid="7eaa559b-6119-4ef5-b0f4-8e108099d682">
Nov 14 19:30:41 user nova-compute[75205]:           <nova:ip type="fixed" address="192.168.233.14" ipVersion="4"/>
Nov 14 19:30:41 user nova-compute[75205]:         </nova:port>
Nov 14 19:30:41 user nova-compute[75205]:       </nova:ports>
Nov 14 19:30:41 user nova-compute[75205]:     </nova:instance>
Nov 14 19:30:41 user nova-compute[75205]:   </metadata>
Nov 14 19:30:41 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:30:41 user nova-compute[75205]:     <system>
Nov 14 19:30:41 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:30:41 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:30:41 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:30:41 user nova-compute[75205]:       <entry name="serial">1c22d069-fa97-4996-8649-a81d988f6b04</entry>
Nov 14 19:30:41 user nova-compute[75205]:       <entry name="uuid">1c22d069-fa97-4996-8649-a81d988f6b04</entry>
Nov 14 19:30:41 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:30:41 user nova-compute[75205]:     </system>
Nov 14 19:30:41 user nova-compute[75205]:   </sysinfo>
Nov 14 19:30:41 user nova-compute[75205]:   <os>
Nov 14 19:30:41 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:30:41 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:30:41 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:30:41 user nova-compute[75205]:   </os>
Nov 14 19:30:41 user nova-compute[75205]:   <features>
Nov 14 19:30:41 user nova-compute[75205]:     <acpi/>
Nov 14 19:30:41 user nova-compute[75205]:     <apic/>
Nov 14 19:30:41 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:30:41 user nova-compute[75205]:   </features>
Nov 14 19:30:41 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:30:41 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:30:41 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:30:41 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:30:41 user nova-compute[75205]:   </clock>
Nov 14 19:30:41 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:30:41 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:30:41 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:30:41 user nova-compute[75205]:   </cpu>
Nov 14 19:30:41 user nova-compute[75205]:   <devices>
Nov 14 19:30:41 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:30:41 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:30:41 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk"/>
Nov 14 19:30:41 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:30:41 user nova-compute[75205]:     </disk>
Nov 14 19:30:41 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:30:41 user nova-compute[75205]:       <mac address="fa:16:3e:89:19:fa"/>
Nov 14 19:30:41 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:30:41 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:30:41 user nova-compute[75205]:       <target dev="tap7eaa559b-61"/>
Nov 14 19:30:41 user nova-compute[75205]:     </interface>
Nov 14 19:30:41 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:30:41 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/console.log" append="off"/>
Nov 14 19:30:41 user nova-compute[75205]:     </serial>
Nov 14 19:30:41 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:30:41 user nova-compute[75205]:     <video>
Nov 14 19:30:41 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:30:41 user nova-compute[75205]:     </video>
Nov 14 19:30:41 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:30:41 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:30:41 user nova-compute[75205]:     </rng>
Nov 14 19:30:41 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:30:41 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:30:41 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:30:41 user nova-compute[75205]:     </memballoon>
Nov 14 19:30:41 user nova-compute[75205]:   </devices>
Nov 14 19:30:41 user nova-compute[75205]: </domain>
Nov 14 19:30:41 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1418004782',display_name='tempest-VolumesNegativeTest-instance-1418004782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1418004782',id=43,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772fcf8ca41e40dba8aca19cb84fae02',ramdisk_id='',reservation_id='r-3zshqqdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1287488018',owner_user_name='tempest-VolumesNegativeTest-1287488018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:30:40Z,user_data=None,user_id='68c823d07b2f4e4e9c640733ad31bc0e',uuid=1c22d069-fa97-4996-8649-a81d988f6b04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "address": "fa:16:3e:89:19:fa", "network": {"id": "649a39b9-64ae-4eee-b59a-f31c4bd805bf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7d3978d4ce0a499fa185e937ee9bde95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eaa559b-61", "ovs_interfaceid": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Converting VIF {"id": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "address": "fa:16:3e:89:19:fa", "network": {"id": "649a39b9-64ae-4eee-b59a-f31c4bd805bf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7d3978d4ce0a499fa185e937ee9bde95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eaa559b-61", "ovs_interfaceid": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:fa,bridge_name='br-int',has_traffic_filtering=True,id=7eaa559b-6119-4ef5-b0f4-8e108099d682,network=Network(649a39b9-64ae-4eee-b59a-f31c4bd805bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eaa559b-61') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG os_vif [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:fa,bridge_name='br-int',has_traffic_filtering=True,id=7eaa559b-6119-4ef5-b0f4-8e108099d682,network=Network(649a39b9-64ae-4eee-b59a-f31c4bd805bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eaa559b-61') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45ecb459-e32f-560a-ab86-cdddd7b261f0', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7eaa559b-61, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7eaa559b-61, col_values=(('qos', UUID('c7883b01-e111-42cf-a098-7250d17febbd')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7eaa559b-61, col_values=(('external_ids', {'iface-id': '7eaa559b-6119-4ef5-b0f4-8e108099d682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:19:fa', 'vm-uuid': '1c22d069-fa97-4996-8649-a81d988f6b04'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:41 user nova-compute[75205]: INFO os_vif [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:fa,bridge_name='br-int',has_traffic_filtering=True,id=7eaa559b-6119-4ef5-b0f4-8e108099d682,network=Network(649a39b9-64ae-4eee-b59a-f31c4bd805bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eaa559b-61')
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:30:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] No VIF found with MAC fa:16:3e:89:19:fa, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:30:42 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:30:42 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:30:42 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:30:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-eafbaa4e-7063-4439-a4a0-dd76553dc2d1 req-8f1f47a3-7f8e-4809-b6c1-8984994d0ca5 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Updated VIF entry in instance network info cache for port 7eaa559b-6119-4ef5-b0f4-8e108099d682. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:30:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-eafbaa4e-7063-4439-a4a0-dd76553dc2d1 req-8f1f47a3-7f8e-4809-b6c1-8984994d0ca5 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Updating instance_info_cache with network_info: [{"id": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "address": "fa:16:3e:89:19:fa", "network": {"id": "649a39b9-64ae-4eee-b59a-f31c4bd805bf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7d3978d4ce0a499fa185e937ee9bde95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eaa559b-61", "ovs_interfaceid": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:30:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-eafbaa4e-7063-4439-a4a0-dd76553dc2d1 req-8f1f47a3-7f8e-4809-b6c1-8984994d0ca5 service nova] Releasing lock "refresh_cache-1c22d069-fa97-4996-8649-a81d988f6b04" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:30:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "22b41998-e98e-4797-b28d-db091cea8112" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:43 user nova-compute[75205]: INFO nova.compute.manager [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Shelving
Nov 14 19:30:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-56da9592-f321-48e3-939f-bc928636fa52 req-84cc8b87-5151-42ba-a93e-e8d1b3b10de4 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-vif-unplugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-56da9592-f321-48e3-939f-bc928636fa52 req-84cc8b87-5151-42ba-a93e-e8d1b3b10de4 service nova] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-56da9592-f321-48e3-939f-bc928636fa52 req-84cc8b87-5151-42ba-a93e-e8d1b3b10de4 service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-56da9592-f321-48e3-939f-bc928636fa52 req-84cc8b87-5151-42ba-a93e-e8d1b3b10de4 service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-56da9592-f321-48e3-939f-bc928636fa52 req-84cc8b87-5151-42ba-a93e-e8d1b3b10de4 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] No waiting events found dispatching network-vif-unplugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:30:43 user nova-compute[75205]: WARNING nova.compute.manager [req-56da9592-f321-48e3-939f-bc928636fa52 req-84cc8b87-5151-42ba-a93e-e8d1b3b10de4 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received unexpected event network-vif-unplugged-59acb1f8-f517-493d-bab2-257903a6a353 for instance with vm_state active and task_state shelving.
Nov 14 19:30:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-9574384e-ea7c-4b85-9956-ef4ec1232854 req-c6f2e154-90df-45dc-9731-433f56922b56 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Received event network-vif-plugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9574384e-ea7c-4b85-9956-ef4ec1232854 req-c6f2e154-90df-45dc-9731-433f56922b56 service nova] Acquiring lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9574384e-ea7c-4b85-9956-ef4ec1232854 req-c6f2e154-90df-45dc-9731-433f56922b56 service nova] Lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9574384e-ea7c-4b85-9956-ef4ec1232854 req-c6f2e154-90df-45dc-9731-433f56922b56 service nova] Lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-9574384e-ea7c-4b85-9956-ef4ec1232854 req-c6f2e154-90df-45dc-9731-433f56922b56 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] No waiting events found dispatching network-vif-plugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:30:43 user nova-compute[75205]: WARNING nova.compute.manager [req-9574384e-ea7c-4b85-9956-ef4ec1232854 req-c6f2e154-90df-45dc-9731-433f56922b56 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Received unexpected event network-vif-plugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 for instance with vm_state building and task_state spawning.
Nov 14 19:30:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance destroyed successfully.
Nov 14 19:30:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:43 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Beginning cold snapshot process
Nov 14 19:30:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:30:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:30:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:30:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Skipping network cache update for instance because it is Building. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 19:30:44 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:30:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk /opt/stack/data/nova/instances/snapshots/tmpwsx40k14/f43b075b382f4322ae41a4671654f019 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:30:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:30:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:30:44 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:30:44 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 934d0407-7d12-4edb-99d2-8558be6427d6 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:30:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk /opt/stack/data/nova/instances/snapshots/tmpwsx40k14/f43b075b382f4322ae41a4671654f019" returned: 0 in 0.737s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:30:44 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Snapshot extracted, beginning image upload
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updating instance_info_cache with network_info: [{"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-934d0407-7d12-4edb-99d2-8558be6427d6" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-39f5f95e-9ecc-45b0-929a-c17bd20d4d3d req-4e2cc21e-2761-4a2a-907d-52c0c9f29a5b service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-39f5f95e-9ecc-45b0-929a-c17bd20d4d3d req-4e2cc21e-2761-4a2a-907d-52c0c9f29a5b service nova] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-39f5f95e-9ecc-45b0-929a-c17bd20d4d3d req-4e2cc21e-2761-4a2a-907d-52c0c9f29a5b service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-39f5f95e-9ecc-45b0-929a-c17bd20d4d3d req-4e2cc21e-2761-4a2a-907d-52c0c9f29a5b service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-39f5f95e-9ecc-45b0-929a-c17bd20d4d3d req-4e2cc21e-2761-4a2a-907d-52c0c9f29a5b service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] No waiting events found dispatching network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:30:45 user nova-compute[75205]: WARNING nova.compute.manager [req-39f5f95e-9ecc-45b0-929a-c17bd20d4d3d req-4e2cc21e-2761-4a2a-907d-52c0c9f29a5b service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received unexpected event network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-69385bcc-259b-49a1-bec1-61b57d06207f req-e87cade1-1785-4526-bee3-db2f2871efca service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Received event network-vif-plugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69385bcc-259b-49a1-bec1-61b57d06207f req-e87cade1-1785-4526-bee3-db2f2871efca service nova] Acquiring lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69385bcc-259b-49a1-bec1-61b57d06207f req-e87cade1-1785-4526-bee3-db2f2871efca service nova] Lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69385bcc-259b-49a1-bec1-61b57d06207f req-e87cade1-1785-4526-bee3-db2f2871efca service nova] Lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-69385bcc-259b-49a1-bec1-61b57d06207f req-e87cade1-1785-4526-bee3-db2f2871efca service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] No waiting events found dispatching network-vif-plugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:30:45 user nova-compute[75205]: WARNING nova.compute.manager [req-69385bcc-259b-49a1-bec1-61b57d06207f req-e87cade1-1785-4526-bee3-db2f2871efca service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Received unexpected event network-vif-plugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 for instance with vm_state building and task_state spawning.
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:30:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Instance spawned successfully.
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:30:45 user nova-compute[75205]: INFO nova.compute.manager [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 14 19:30:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:30:45 user nova-compute[75205]: INFO nova.compute.manager [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Took 6.92 seconds to build instance.
Nov 14 19:30:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-780b4d54-6993-4ba2-ac3e-a5846e976108 tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "1c22d069-fa97-4996-8649-a81d988f6b04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.013s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Snapshot image upload complete
Nov 14 19:30:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:30:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:47 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:30:47 user nova-compute[75205]: INFO nova.compute.manager [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Shelve offloading
Nov 14 19:30:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance destroyed successfully.
Nov 14 19:30:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:30:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:30:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquired lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:30:47 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:30:47 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updating instance_info_cache with network_info: [{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:30:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Releasing lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:30:48 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance destroyed successfully.
Nov 14 19:30:48 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'resources' on Instance uuid 22b41998-e98e-4797-b28d-db091cea8112 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948750380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948750380',id=40,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6NuEZLLKqjrnXTThDPmuk66mkWNn97l1L3F002JaTttyz5nOrN6mt3Nf9t7RNYYHJZFLY2/aIe4WNw25syEjYXJE259MN8mMXrHiRyQBeVh3lpD9FUpk1ebT2cG639ig==',key_name='tempest-keypair-1858313542',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:28:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-9kjdv1bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member',shelved_at='2023-11-14T19:30:47.326231',shelved_host='user',shelved_image_id='f87898b4-f42f-4290-aca9-0807295af038'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:30:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=22b41998-e98e-4797-b28d-db091cea8112,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG os_vif [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59acb1f8-f5, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-3f1c923b-a5f4-425a-9e4e-68c5a876714a req-6e0abb01-fe45-438b-88d2-af0ff0e25ffd service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-changed-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-3f1c923b-a5f4-425a-9e4e-68c5a876714a req-6e0abb01-fe45-438b-88d2-af0ff0e25ffd service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Refreshing instance network info cache due to event network-changed-59acb1f8-f517-493d-bab2-257903a6a353. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3f1c923b-a5f4-425a-9e4e-68c5a876714a req-6e0abb01-fe45-438b-88d2-af0ff0e25ffd service nova] Acquiring lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3f1c923b-a5f4-425a-9e4e-68c5a876714a req-6e0abb01-fe45-438b-88d2-af0ff0e25ffd service nova] Acquired lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG nova.network.neutron [req-3f1c923b-a5f4-425a-9e4e-68c5a876714a req-6e0abb01-fe45-438b-88d2-af0ff0e25ffd service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Refreshing network info cache for port 59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62fb2945-a5ba-40a5-89e6-2e079a4a7f2e) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:48 user nova-compute[75205]: INFO os_vif [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5')
Nov 14 19:30:48 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Deleting instance files /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112_del
Nov 14 19:30:48 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Deletion of /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112_del complete
Nov 14 19:30:48 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Deleted allocations for instance 22b41998-e98e-4797-b28d-db091cea8112
Nov 14 19:30:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'numa_topology' on Instance uuid 22b41998-e98e-4797-b28d-db091cea8112 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:30:48 user nova-compute[75205]: DEBUG nova.objects.base [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Object Instance<22b41998-e98e-4797-b28d-db091cea8112> lazy-loaded attributes: resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:30:49 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:30:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:30:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:49 user nova-compute[75205]: DEBUG nova.network.neutron [req-3f1c923b-a5f4-425a-9e4e-68c5a876714a req-6e0abb01-fe45-438b-88d2-af0ff0e25ffd service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updated VIF entry in instance network info cache for port 59acb1f8-f517-493d-bab2-257903a6a353. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:30:49 user nova-compute[75205]: DEBUG nova.network.neutron [req-3f1c923b-a5f4-425a-9e4e-68c5a876714a req-6e0abb01-fe45-438b-88d2-af0ff0e25ffd service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updating instance_info_cache with network_info: [{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:30:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3f1c923b-a5f4-425a-9e4e-68c5a876714a req-6e0abb01-fe45-438b-88d2-af0ff0e25ffd service nova] Releasing lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:30:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b60d5f84-9645-408a-9374-cdc1990437d7 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "22b41998-e98e-4797-b28d-db091cea8112" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.110s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:30:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:30:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:30:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Acquiring lock "04a4b26b-540f-4748-846f-4da567ab8cc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Acquiring lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:13 user nova-compute[75205]: INFO nova.compute.manager [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Terminating instance
Nov 14 19:31:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-75a823ca-515a-4ebd-8910-94546ff6088c req-304e626f-8546-48c6-a3e8-01e0cb9adb89 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Received event network-vif-unplugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-75a823ca-515a-4ebd-8910-94546ff6088c req-304e626f-8546-48c6-a3e8-01e0cb9adb89 service nova] Acquiring lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-75a823ca-515a-4ebd-8910-94546ff6088c req-304e626f-8546-48c6-a3e8-01e0cb9adb89 service nova] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-75a823ca-515a-4ebd-8910-94546ff6088c req-304e626f-8546-48c6-a3e8-01e0cb9adb89 service nova] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-75a823ca-515a-4ebd-8910-94546ff6088c req-304e626f-8546-48c6-a3e8-01e0cb9adb89 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] No waiting events found dispatching network-vif-unplugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:31:13 user nova-compute[75205]: DEBUG nova.compute.manager [req-75a823ca-515a-4ebd-8910-94546ff6088c req-304e626f-8546-48c6-a3e8-01e0cb9adb89 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Received event network-vif-unplugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Instance destroyed successfully.
Nov 14 19:31:14 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lazy-loading 'resources' on Instance uuid 04a4b26b-540f-4748-846f-4da567ab8cc7 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1552227333',display_name='tempest-VolumesActionsTest-instance-1552227333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1552227333',id=41,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:29:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='689cf0600a644d749771f58f5d6feb67',ramdisk_id='',reservation_id='r-rv9x3ut2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1801652857',owner_user_name='tempest-VolumesActionsTest-1801652857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:29:25Z,user_data=None,user_id='0709d4c2361940bca1cf7749ab82349d',uuid=04a4b26b-540f-4748-846f-4da567ab8cc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "address": "fa:16:3e:a7:f1:88", "network": {"id": "c8ee47b0-b338-49f7-be25-8df0a84f3407", "bridge": "br-int", "label": "tempest-VolumesActionsTest-642748005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "689cf0600a644d749771f58f5d6feb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2780e3-a4", "ovs_interfaceid": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Converting VIF {"id": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "address": "fa:16:3e:a7:f1:88", "network": {"id": "c8ee47b0-b338-49f7-be25-8df0a84f3407", "bridge": "br-int", "label": "tempest-VolumesActionsTest-642748005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "689cf0600a644d749771f58f5d6feb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2780e3-a4", "ovs_interfaceid": "5f2780e3-a410-4495-8df0-80c87a4ad2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:88,bridge_name='br-int',has_traffic_filtering=True,id=5f2780e3-a410-4495-8df0-80c87a4ad2c7,network=Network(c8ee47b0-b338-49f7-be25-8df0a84f3407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2780e3-a4') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG os_vif [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:88,bridge_name='br-int',has_traffic_filtering=True,id=5f2780e3-a410-4495-8df0-80c87a4ad2c7,network=Network(c8ee47b0-b338-49f7-be25-8df0a84f3407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2780e3-a4') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f2780e3-a4, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03b60338-da32-4aca-b835-c62ea39cda6f) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:14 user nova-compute[75205]: INFO os_vif [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:88,bridge_name='br-int',has_traffic_filtering=True,id=5f2780e3-a410-4495-8df0-80c87a4ad2c7,network=Network(c8ee47b0-b338-49f7-be25-8df0a84f3407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2780e3-a4')
Nov 14 19:31:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Deleting instance files /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7_del
Nov 14 19:31:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Deletion of /opt/stack/data/nova/instances/04a4b26b-540f-4748-846f-4da567ab8cc7_del complete
Nov 14 19:31:14 user nova-compute[75205]: INFO nova.compute.manager [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 19:31:14 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:31:14 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Took 0.50 seconds to deallocate network for instance.
Nov 14 19:31:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:15 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:31:15 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:31:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:15 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Deleted allocations for instance 04a4b26b-540f-4748-846f-4da567ab8cc7
Nov 14 19:31:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d769ad4-7094-4a19-96e2-1d7bb9a222d8 tempest-VolumesActionsTest-1801652857 tempest-VolumesActionsTest-1801652857-project-member] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.764s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:15 user nova-compute[75205]: DEBUG nova.compute.manager [req-358e79df-a893-4e52-9703-faa8ec3cb639 req-f0b9bf7a-a035-481a-baf8-307df48a67d5 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Received event network-vif-plugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-358e79df-a893-4e52-9703-faa8ec3cb639 req-f0b9bf7a-a035-481a-baf8-307df48a67d5 service nova] Acquiring lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-358e79df-a893-4e52-9703-faa8ec3cb639 req-f0b9bf7a-a035-481a-baf8-307df48a67d5 service nova] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-358e79df-a893-4e52-9703-faa8ec3cb639 req-f0b9bf7a-a035-481a-baf8-307df48a67d5 service nova] Lock "04a4b26b-540f-4748-846f-4da567ab8cc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:15 user nova-compute[75205]: DEBUG nova.compute.manager [req-358e79df-a893-4e52-9703-faa8ec3cb639 req-f0b9bf7a-a035-481a-baf8-307df48a67d5 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] No waiting events found dispatching network-vif-plugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:31:15 user nova-compute[75205]: WARNING nova.compute.manager [req-358e79df-a893-4e52-9703-faa8ec3cb639 req-f0b9bf7a-a035-481a-baf8-307df48a67d5 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Received unexpected event network-vif-plugged-5f2780e3-a410-4495-8df0-80c87a4ad2c7 for instance with vm_state deleted and task_state None.
Nov 14 19:31:15 user nova-compute[75205]: DEBUG nova.compute.manager [req-358e79df-a893-4e52-9703-faa8ec3cb639 req-f0b9bf7a-a035-481a-baf8-307df48a67d5 service nova] [instance: 04a4b26b-540f-4748-846f-4da567ab8cc7] Received event network-vif-deleted-5f2780e3-a410-4495-8df0-80c87a4ad2c7 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:31:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "7260ad81-fc37-4726-8fee-9adecb58040f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "7260ad81-fc37-4726-8fee-9adecb58040f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:38 user nova-compute[75205]: INFO nova.compute.manager [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Terminating instance
Nov 14 19:31:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG nova.compute.manager [req-3e098df5-75bc-49eb-9175-28f36a7f1ae7 req-968f1233-6a3d-4fa8-9b33-d2e3a68584c3 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Received event network-vif-unplugged-706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3e098df5-75bc-49eb-9175-28f36a7f1ae7 req-968f1233-6a3d-4fa8-9b33-d2e3a68584c3 service nova] Acquiring lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3e098df5-75bc-49eb-9175-28f36a7f1ae7 req-968f1233-6a3d-4fa8-9b33-d2e3a68584c3 service nova] Lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3e098df5-75bc-49eb-9175-28f36a7f1ae7 req-968f1233-6a3d-4fa8-9b33-d2e3a68584c3 service nova] Lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG nova.compute.manager [req-3e098df5-75bc-49eb-9175-28f36a7f1ae7 req-968f1233-6a3d-4fa8-9b33-d2e3a68584c3 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] No waiting events found dispatching network-vif-unplugged-706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:31:38 user nova-compute[75205]: DEBUG nova.compute.manager [req-3e098df5-75bc-49eb-9175-28f36a7f1ae7 req-968f1233-6a3d-4fa8-9b33-d2e3a68584c3 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Received event network-vif-unplugged-706a5e48-f3b1-445d-b039-930e1ace4068 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Instance destroyed successfully.
Nov 14 19:31:39 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lazy-loading 'resources' on Instance uuid 7260ad81-fc37-4726-8fee-9adecb58040f {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1028152262',display_name='tempest-ServersNegativeTestJSON-server-1028152262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1028152262',id=35,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:23:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80601810103b45acaf3c28a876fb51d8',ramdisk_id='',reservation_id='r-6xzaur15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-405327324',owner_user_name='tempest-ServersNegativeTestJSON-405327324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:23:05Z,user_data=None,user_id='406f12b163cb4a989209213026aae994',uuid=7260ad81-fc37-4726-8fee-9adecb58040f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converting VIF {"id": "706a5e48-f3b1-445d-b039-930e1ace4068", "address": "fa:16:3e:2e:ac:d5", "network": {"id": "ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1084830462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80601810103b45acaf3c28a876fb51d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap706a5e48-f3", "ovs_interfaceid": "706a5e48-f3b1-445d-b039-930e1ace4068", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ac:d5,bridge_name='br-int',has_traffic_filtering=True,id=706a5e48-f3b1-445d-b039-930e1ace4068,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706a5e48-f3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG os_vif [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ac:d5,bridge_name='br-int',has_traffic_filtering=True,id=706a5e48-f3b1-445d-b039-930e1ace4068,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706a5e48-f3') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap706a5e48-f3, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f22bfba-a4e8-46d6-9eaf-9ef88411b34f) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:31:39 user nova-compute[75205]: INFO os_vif [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ac:d5,bridge_name='br-int',has_traffic_filtering=True,id=706a5e48-f3b1-445d-b039-930e1ace4068,network=Network(ebf0c939-3ff8-498d-9fbc-7c30bf1bd6b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706a5e48-f3')
Nov 14 19:31:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Deleting instance files /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f_del
Nov 14 19:31:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Deletion of /opt/stack/data/nova/instances/7260ad81-fc37-4726-8fee-9adecb58040f_del complete
Nov 14 19:31:39 user nova-compute[75205]: INFO nova.compute.manager [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 19:31:39 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:31:39 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Took 0.43 seconds to deallocate network for instance.
Nov 14 19:31:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-405eefa3-c337-4595-a5ba-c722ffa8edeb req-3dde098e-508e-4006-8d42-6c90b61a5b54 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Received event network-vif-deleted-706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:39 user nova-compute[75205]: INFO nova.compute.manager [req-405eefa3-c337-4595-a5ba-c722ffa8edeb req-3dde098e-508e-4006-8d42-6c90b61a5b54 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Neutron deleted interface 706a5e48-f3b1-445d-b039-930e1ace4068; detaching it from the instance and deleting it from the info cache
Nov 14 19:31:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-405eefa3-c337-4595-a5ba-c722ffa8edeb req-3dde098e-508e-4006-8d42-6c90b61a5b54 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-405eefa3-c337-4595-a5ba-c722ffa8edeb req-3dde098e-508e-4006-8d42-6c90b61a5b54 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Detach interface failed, port_id=706a5e48-f3b1-445d-b039-930e1ace4068, reason: Instance 7260ad81-fc37-4726-8fee-9adecb58040f could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:40 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Deleted allocations for instance 7260ad81-fc37-4726-8fee-9adecb58040f
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7465fc13-d821-4bc0-8ae2-6463330e5e20 tempest-ServersNegativeTestJSON-405327324 tempest-ServersNegativeTestJSON-405327324-project-member] Lock "7260ad81-fc37-4726-8fee-9adecb58040f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-50de9045-89e4-4654-825a-99ddd33c46be req-1f1198c2-cb79-49f1-a105-10aa0f332417 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Received event network-vif-plugged-706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-50de9045-89e4-4654-825a-99ddd33c46be req-1f1198c2-cb79-49f1-a105-10aa0f332417 service nova] Acquiring lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-50de9045-89e4-4654-825a-99ddd33c46be req-1f1198c2-cb79-49f1-a105-10aa0f332417 service nova] Lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-50de9045-89e4-4654-825a-99ddd33c46be req-1f1198c2-cb79-49f1-a105-10aa0f332417 service nova] Lock "7260ad81-fc37-4726-8fee-9adecb58040f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-50de9045-89e4-4654-825a-99ddd33c46be req-1f1198c2-cb79-49f1-a105-10aa0f332417 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] No waiting events found dispatching network-vif-plugged-706a5e48-f3b1-445d-b039-930e1ace4068 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:31:40 user nova-compute[75205]: WARNING nova.compute.manager [req-50de9045-89e4-4654-825a-99ddd33c46be req-1f1198c2-cb79-49f1-a105-10aa0f332417 service nova] [instance: 7260ad81-fc37-4726-8fee-9adecb58040f] Received unexpected event network-vif-plugged-706a5e48-f3b1-445d-b039-930e1ace4068 for instance with vm_state deleted and task_state None.
Nov 14 19:31:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:31:41 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:31:41 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8281MB free_disk=25.151065826416016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 602429d1-cfd8-4984-97db-b086f9d1ecfd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 298a5eb2-6362-40bd-93fa-2cad9b07718a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 8abc2e08-6973-4bed-93a6-4a33255201a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 1c22d069-fa97-4996-8649-a81d988f6b04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-9ad179e4-6383-4252-acfe-7cb95a2da482 req-404e9ae0-fe9c-4e2c-b337-9331bd19b06c service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received event network-changed-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-9ad179e4-6383-4252-acfe-7cb95a2da482 req-404e9ae0-fe9c-4e2c-b337-9331bd19b06c service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Refreshing instance network info cache due to event network-changed-1d944d4e-ebee-4cae-8448-0b7f00ac89f6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9ad179e4-6383-4252-acfe-7cb95a2da482 req-404e9ae0-fe9c-4e2c-b337-9331bd19b06c service nova] Acquiring lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9ad179e4-6383-4252-acfe-7cb95a2da482 req-404e9ae0-fe9c-4e2c-b337-9331bd19b06c service nova] Acquired lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:31:41 user nova-compute[75205]: DEBUG nova.network.neutron [req-9ad179e4-6383-4252-acfe-7cb95a2da482 req-404e9ae0-fe9c-4e2c-b337-9331bd19b06c service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Refreshing network info cache for port 1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:31:42 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:31:42 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:31:42 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:31:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-9ad179e4-6383-4252-acfe-7cb95a2da482 req-404e9ae0-fe9c-4e2c-b337-9331bd19b06c service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Updated VIF entry in instance network info cache for port 1d944d4e-ebee-4cae-8448-0b7f00ac89f6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:31:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-9ad179e4-6383-4252-acfe-7cb95a2da482 req-404e9ae0-fe9c-4e2c-b337-9331bd19b06c service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Updating instance_info_cache with network_info: [{"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:31:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9ad179e4-6383-4252-acfe-7cb95a2da482 req-404e9ae0-fe9c-4e2c-b337-9331bd19b06c service nova] Releasing lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:31:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-720e3e00-172e-4afc-a5ad-96c66331ea69 req-4859fb85-3e78-4673-9593-8d189f5909d7 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received event network-changed-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-720e3e00-172e-4afc-a5ad-96c66331ea69 req-4859fb85-3e78-4673-9593-8d189f5909d7 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Refreshing instance network info cache due to event network-changed-1d944d4e-ebee-4cae-8448-0b7f00ac89f6. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-720e3e00-172e-4afc-a5ad-96c66331ea69 req-4859fb85-3e78-4673-9593-8d189f5909d7 service nova] Acquiring lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-720e3e00-172e-4afc-a5ad-96c66331ea69 req-4859fb85-3e78-4673-9593-8d189f5909d7 service nova] Acquired lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-720e3e00-172e-4afc-a5ad-96c66331ea69 req-4859fb85-3e78-4673-9593-8d189f5909d7 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Refreshing network info cache for port 1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "8abc2e08-6973-4bed-93a6-4a33255201a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:43 user nova-compute[75205]: INFO nova.compute.manager [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Terminating instance
Nov 14 19:31:43 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:31:43 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-98f1f7dd-1315-4935-adb4-df3da0eb18a1 req-0b911a23-1bbb-4011-a30d-8bf9e440cafe service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received event network-vif-unplugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-98f1f7dd-1315-4935-adb4-df3da0eb18a1 req-0b911a23-1bbb-4011-a30d-8bf9e440cafe service nova] Acquiring lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-98f1f7dd-1315-4935-adb4-df3da0eb18a1 req-0b911a23-1bbb-4011-a30d-8bf9e440cafe service nova] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-98f1f7dd-1315-4935-adb4-df3da0eb18a1 req-0b911a23-1bbb-4011-a30d-8bf9e440cafe service nova] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-98f1f7dd-1315-4935-adb4-df3da0eb18a1 req-0b911a23-1bbb-4011-a30d-8bf9e440cafe service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] No waiting events found dispatching network-vif-unplugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-98f1f7dd-1315-4935-adb4-df3da0eb18a1 req-0b911a23-1bbb-4011-a30d-8bf9e440cafe service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received event network-vif-unplugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.network.neutron [req-720e3e00-172e-4afc-a5ad-96c66331ea69 req-4859fb85-3e78-4673-9593-8d189f5909d7 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Updated VIF entry in instance network info cache for port 1d944d4e-ebee-4cae-8448-0b7f00ac89f6. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.network.neutron [req-720e3e00-172e-4afc-a5ad-96c66331ea69 req-4859fb85-3e78-4673-9593-8d189f5909d7 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Updating instance_info_cache with network_info: [{"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-720e3e00-172e-4afc-a5ad-96c66331ea69 req-4859fb85-3e78-4673-9593-8d189f5909d7 service nova] Releasing lock "refresh_cache-8abc2e08-6973-4bed-93a6-4a33255201a2" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:31:44 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Instance destroyed successfully.
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'resources' on Instance uuid 8abc2e08-6973-4bed-93a6-4a33255201a2 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1800687263',display_name='tempest-TestVolumeBootPattern-server-1800687263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1800687263',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4lflwSUeyVbH81QiQ0Uh3cKzramHeRM7aduqUtZ4pb3+SjiUT5tItPthN7NGlihkCZ2OzXolgwmiBolVRT+jaN4ru1XGIc7ZtqCPOyOWGe8i2eYeT/Jps/FMv13SMF/w==',key_name='tempest-TestVolumeBootPattern-186737572',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:30:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-0n3qaosb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:30:00Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=8abc2e08-6973-4bed-93a6-4a33255201a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "address": "fa:16:3e:7f:a3:a4", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d944d4e-eb", "ovs_interfaceid": "1d944d4e-ebee-4cae-8448-0b7f00ac89f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a3:a4,bridge_name='br-int',has_traffic_filtering=True,id=1d944d4e-ebee-4cae-8448-0b7f00ac89f6,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d944d4e-eb') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_vif [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a3:a4,bridge_name='br-int',has_traffic_filtering=True,id=1d944d4e-ebee-4cae-8448-0b7f00ac89f6,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d944d4e-eb') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d944d4e-eb, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=393469c3-d09c-4e01-9f2f-7d0885ae09bf) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:31:44 user nova-compute[75205]: INFO os_vif [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a3:a4,bridge_name='br-int',has_traffic_filtering=True,id=1d944d4e-ebee-4cae-8448-0b7f00ac89f6,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d944d4e-eb')
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PATlspQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:31:44 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bdcfaf-d492-4781-9668-75f34d9b34e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:31:44 user nova-compute[75205]: No targets found.
Nov 14 19:31:44 user nova-compute[75205]: iSNS:
Nov 14 19:31:44 user nova-compute[75205]: No targets found.
Nov 14 19:31:44 user nova-compute[75205]: STATIC:
Nov 14 19:31:44 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b
Nov 14 19:31:44 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:31:44 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:31:44 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a
Nov 14 19:31:44 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:31:44 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:31:44 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c
Nov 14 19:31:44 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:31:44 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:31:44 user nova-compute[75205]: FIRMWARE:
Nov 14 19:31:44 user nova-compute[75205]: No targets found.
Nov 14 19:31:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:31:44 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:31:44 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e5eca2-0f1e-4d8a-8a02-31d4997a5489]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[21085c44-f7d3-4280-bb07-dda76d5b1b28]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:31:44 user nova-compute[75205]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:31:44 user nova-compute[75205]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b (non-flash)
Nov 14 19:31:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:31:44 user nova-compute[75205]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:31:44 user nova-compute[75205]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b (non-flash)
Nov 14 19:31:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c3a5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b'): ({'sdd'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Removing single pathed devices sdd {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4990775-b329-434e-944d-97eebbadf44a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[99301ea7-8387-4a0e-92e8-a26c6240de4e]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flushing IO for device /dev/sdd {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[328088f5-3f71-46bd-a2a1-e94fde20d76d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[94475847-7683-4828-ba2d-d17ab6aeeb60]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1ad197c3-bedfbde4a735568c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1ad197c3', '/dev/disk/by-id/scsi-26265646662646534') {{(pid=85714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21ac4c8-d9f4-4a56-91dc-d4e2ea756786]: (4, None) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[542c5b51-9cf9-4848-b9a4-5e0145a485f5]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[349b4013-f889-4554-8fe5-21679b5a3a49]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b, portal: 172.16.0.220,3260]
Nov 14 19:31:44 user nova-compute[75205]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b, portal: 172.16.0.220,3260] successful.
Nov 14 19:31:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fbeb5ca-35d2-43c8-bf20-c57accce411b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adb06c2-9e04-4a1d-82cc-c203a1eff077]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== disconnect_volume: return (302ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:31:44 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Deleting instance files /opt/stack/data/nova/instances/8abc2e08-6973-4bed-93a6-4a33255201a2_del
Nov 14 19:31:44 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Deletion of /opt/stack/data/nova/instances/8abc2e08-6973-4bed-93a6-4a33255201a2_del complete
Nov 14 19:31:44 user nova-compute[75205]: INFO nova.compute.manager [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating instance_info_cache with network_info: [{"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-298a5eb2-6362-40bd-93fa-2cad9b07718a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:31:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:31:45 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:31:45 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Took 0.41 seconds to deallocate network for instance.
Nov 14 19:31:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-18a9e3b7-2159-4b4c-a6dd-1bb0bfba3e39 req-7eb80118-da99-4c18-a2d2-d6d883e9d350 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received event network-vif-deleted-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:46 user nova-compute[75205]: INFO nova.compute.manager [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 19:31:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-604565b3-46b8-42df-a0f6-49dd27e2d1cd req-6509653d-f490-40a4-b76e-42cc90914ee6 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received event network-vif-plugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:31:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-604565b3-46b8-42df-a0f6-49dd27e2d1cd req-6509653d-f490-40a4-b76e-42cc90914ee6 service nova] Acquiring lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:31:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-604565b3-46b8-42df-a0f6-49dd27e2d1cd req-6509653d-f490-40a4-b76e-42cc90914ee6 service nova] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:31:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-604565b3-46b8-42df-a0f6-49dd27e2d1cd req-6509653d-f490-40a4-b76e-42cc90914ee6 service nova] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-604565b3-46b8-42df-a0f6-49dd27e2d1cd req-6509653d-f490-40a4-b76e-42cc90914ee6 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] No waiting events found dispatching network-vif-plugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:31:46 user nova-compute[75205]: WARNING nova.compute.manager [req-604565b3-46b8-42df-a0f6-49dd27e2d1cd req-6509653d-f490-40a4-b76e-42cc90914ee6 service nova] [instance: 8abc2e08-6973-4bed-93a6-4a33255201a2] Received unexpected event network-vif-plugged-1d944d4e-ebee-4cae-8448-0b7f00ac89f6 for instance with vm_state deleted and task_state None.
Nov 14 19:31:46 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:31:46 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:31:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:46 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Deleted allocations for instance 8abc2e08-6973-4bed-93a6-4a33255201a2
Nov 14 19:31:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8ae6901e-3d5f-4f5f-a599-4685fef630ba tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "8abc2e08-6973-4bed-93a6-4a33255201a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.712s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:31:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:47 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:31:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:50 user nova-compute[75205]: INFO nova.compute.manager [None req-054348ac-233a-4510-9c1a-d0499f33c6ec tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Get console output
Nov 14 19:31:50 user nova-compute[75205]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 19:31:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:54 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:31:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:32:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Acquiring lock "1c22d069-fa97-4996-8649-a81d988f6b04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "1c22d069-fa97-4996-8649-a81d988f6b04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Acquiring lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:28 user nova-compute[75205]: INFO nova.compute.manager [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Terminating instance
Nov 14 19:32:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-2e86bcb4-797e-4142-92e9-ad93b9f4ff44 req-434aaf67-c1a4-4ab0-b667-07b21f0728ee service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Received event network-vif-unplugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2e86bcb4-797e-4142-92e9-ad93b9f4ff44 req-434aaf67-c1a4-4ab0-b667-07b21f0728ee service nova] Acquiring lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2e86bcb4-797e-4142-92e9-ad93b9f4ff44 req-434aaf67-c1a4-4ab0-b667-07b21f0728ee service nova] Lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2e86bcb4-797e-4142-92e9-ad93b9f4ff44 req-434aaf67-c1a4-4ab0-b667-07b21f0728ee service nova] Lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-2e86bcb4-797e-4142-92e9-ad93b9f4ff44 req-434aaf67-c1a4-4ab0-b667-07b21f0728ee service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] No waiting events found dispatching network-vif-unplugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-2e86bcb4-797e-4142-92e9-ad93b9f4ff44 req-434aaf67-c1a4-4ab0-b667-07b21f0728ee service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Received event network-vif-unplugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:29 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Instance destroyed successfully.
Nov 14 19:32:29 user nova-compute[75205]: DEBUG nova.objects.instance [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lazy-loading 'resources' on Instance uuid 1c22d069-fa97-4996-8649-a81d988f6b04 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1418004782',display_name='tempest-VolumesNegativeTest-instance-1418004782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1418004782',id=43,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:30:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772fcf8ca41e40dba8aca19cb84fae02',ramdisk_id='',reservation_id='r-3zshqqdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1287488018',owner_user_name='tempest-VolumesNegativeTest-1287488018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:30:46Z,user_data=None,user_id='68c823d07b2f4e4e9c640733ad31bc0e',uuid=1c22d069-fa97-4996-8649-a81d988f6b04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "address": "fa:16:3e:89:19:fa", "network": {"id": "649a39b9-64ae-4eee-b59a-f31c4bd805bf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7d3978d4ce0a499fa185e937ee9bde95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eaa559b-61", "ovs_interfaceid": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Converting VIF {"id": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "address": "fa:16:3e:89:19:fa", "network": {"id": "649a39b9-64ae-4eee-b59a-f31c4bd805bf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7d3978d4ce0a499fa185e937ee9bde95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eaa559b-61", "ovs_interfaceid": "7eaa559b-6119-4ef5-b0f4-8e108099d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:fa,bridge_name='br-int',has_traffic_filtering=True,id=7eaa559b-6119-4ef5-b0f4-8e108099d682,network=Network(649a39b9-64ae-4eee-b59a-f31c4bd805bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eaa559b-61') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG os_vif [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:fa,bridge_name='br-int',has_traffic_filtering=True,id=7eaa559b-6119-4ef5-b0f4-8e108099d682,network=Network(649a39b9-64ae-4eee-b59a-f31c4bd805bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eaa559b-61') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7eaa559b-61, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7883b01-e111-42cf-a098-7250d17febbd) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:32:29 user nova-compute[75205]: INFO os_vif [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:fa,bridge_name='br-int',has_traffic_filtering=True,id=7eaa559b-6119-4ef5-b0f4-8e108099d682,network=Network(649a39b9-64ae-4eee-b59a-f31c4bd805bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eaa559b-61')
Nov 14 19:32:29 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Deleting instance files /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04_del
Nov 14 19:32:29 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Deletion of /opt/stack/data/nova/instances/1c22d069-fa97-4996-8649-a81d988f6b04_del complete
Nov 14 19:32:29 user nova-compute[75205]: INFO nova.compute.manager [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 14 19:32:29 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:32:29 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:32:30 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:32:30 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Took 1.11 seconds to deallocate network for instance.
Nov 14 19:32:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:31 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:32:31 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:32:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:31 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Deleted allocations for instance 1c22d069-fa97-4996-8649-a81d988f6b04
Nov 14 19:32:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-195f5f3b-9ef5-4bc1-b9db-353f97c993dd tempest-VolumesNegativeTest-1287488018 tempest-VolumesNegativeTest-1287488018-project-member] Lock "1c22d069-fa97-4996-8649-a81d988f6b04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-dc88d475-7d40-4906-a1a5-4b12d192ba61 req-20b9d5e6-2f8f-4b8e-b89d-041e5440c006 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Received event network-vif-plugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dc88d475-7d40-4906-a1a5-4b12d192ba61 req-20b9d5e6-2f8f-4b8e-b89d-041e5440c006 service nova] Acquiring lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dc88d475-7d40-4906-a1a5-4b12d192ba61 req-20b9d5e6-2f8f-4b8e-b89d-041e5440c006 service nova] Lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dc88d475-7d40-4906-a1a5-4b12d192ba61 req-20b9d5e6-2f8f-4b8e-b89d-041e5440c006 service nova] Lock "1c22d069-fa97-4996-8649-a81d988f6b04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-dc88d475-7d40-4906-a1a5-4b12d192ba61 req-20b9d5e6-2f8f-4b8e-b89d-041e5440c006 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] No waiting events found dispatching network-vif-plugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:31 user nova-compute[75205]: WARNING nova.compute.manager [req-dc88d475-7d40-4906-a1a5-4b12d192ba61 req-20b9d5e6-2f8f-4b8e-b89d-041e5440c006 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Received unexpected event network-vif-plugged-7eaa559b-6119-4ef5-b0f4-8e108099d682 for instance with vm_state deleted and task_state None.
Nov 14 19:32:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-dc88d475-7d40-4906-a1a5-4b12d192ba61 req-20b9d5e6-2f8f-4b8e-b89d-041e5440c006 service nova] [instance: 1c22d069-fa97-4996-8649-a81d988f6b04] Received event network-vif-deleted-7eaa559b-6119-4ef5-b0f4-8e108099d682 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "22b41998-e98e-4797-b28d-db091cea8112" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:36 user nova-compute[75205]: INFO nova.compute.manager [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Unshelving
Nov 14 19:32:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:36 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'pci_requests' on Instance uuid 22b41998-e98e-4797-b28d-db091cea8112 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:32:36 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'numa_topology' on Instance uuid 22b41998-e98e-4797-b28d-db091cea8112 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:32:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:32:36 user nova-compute[75205]: INFO nova.compute.claims [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Claim successful on node user
Nov 14 19:32:36 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:32:36 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:32:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:36 user nova-compute[75205]: INFO nova.network.neutron [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updating port 59acb1f8-f517-493d-bab2-257903a6a353 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 19:32:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:32:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquired lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:32:37 user nova-compute[75205]: DEBUG nova.network.neutron [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:32:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-41d9bd03-5311-4acb-a707-6e238ec96bc1 req-39cb6bd5-0a4a-4d76-98b9-dffc1a8cb3e8 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-changed-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-41d9bd03-5311-4acb-a707-6e238ec96bc1 req-39cb6bd5-0a4a-4d76-98b9-dffc1a8cb3e8 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Refreshing instance network info cache due to event network-changed-59acb1f8-f517-493d-bab2-257903a6a353. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:32:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-41d9bd03-5311-4acb-a707-6e238ec96bc1 req-39cb6bd5-0a4a-4d76-98b9-dffc1a8cb3e8 service nova] Acquiring lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:32:37 user nova-compute[75205]: DEBUG nova.network.neutron [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updating instance_info_cache with network_info: [{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:32:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Releasing lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:32:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:32:38 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Creating image(s)
Nov 14 19:32:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "/opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "/opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "/opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:38 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'trusted_certs' on Instance uuid 22b41998-e98e-4797-b28d-db091cea8112 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:32:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-41d9bd03-5311-4acb-a707-6e238ec96bc1 req-39cb6bd5-0a4a-4d76-98b9-dffc1a8cb3e8 service nova] Acquired lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:32:38 user nova-compute[75205]: DEBUG nova.network.neutron [req-41d9bd03-5311-4acb-a707-6e238ec96bc1 req-39cb6bd5-0a4a-4d76-98b9-dffc1a8cb3e8 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Refreshing network info cache for port 59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:32:38 user nova-compute[75205]: DEBUG nova.objects.base [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Object Instance<22b41998-e98e-4797-b28d-db091cea8112> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:32:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "786f982d08a24e7900db4432ce3f0e84634fa07f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "786f982d08a24e7900db4432ce3f0e84634fa07f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f.part --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-b592670c-921f-48dc-b7ec-c8830bbdcf5d req-4def21bc-81e4-4407-90f5-737d40dd385e service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-changed-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-b592670c-921f-48dc-b7ec-c8830bbdcf5d req-4def21bc-81e4-4407-90f5-737d40dd385e service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Refreshing instance network info cache due to event network-changed-85389b0d-a54a-48df-b551-f057e727cb4f. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b592670c-921f-48dc-b7ec-c8830bbdcf5d req-4def21bc-81e4-4407-90f5-737d40dd385e service nova] Acquiring lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b592670c-921f-48dc-b7ec-c8830bbdcf5d req-4def21bc-81e4-4407-90f5-737d40dd385e service nova] Acquired lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-b592670c-921f-48dc-b7ec-c8830bbdcf5d req-4def21bc-81e4-4407-90f5-737d40dd385e service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Refreshing network info cache for port 85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:39 user nova-compute[75205]: INFO nova.compute.manager [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Terminating instance
Nov 14 19:32:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG nova.virt.images [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] f87898b4-f42f-4290-aca9-0807295af038 was qcow2, converting to raw {{(pid=75205) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f.part /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f.converted {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-41d9bd03-5311-4acb-a707-6e238ec96bc1 req-39cb6bd5-0a4a-4d76-98b9-dffc1a8cb3e8 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updated VIF entry in instance network info cache for port 59acb1f8-f517-493d-bab2-257903a6a353. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-41d9bd03-5311-4acb-a707-6e238ec96bc1 req-39cb6bd5-0a4a-4d76-98b9-dffc1a8cb3e8 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updating instance_info_cache with network_info: [{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-41d9bd03-5311-4acb-a707-6e238ec96bc1 req-39cb6bd5-0a4a-4d76-98b9-dffc1a8cb3e8 service nova] Releasing lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f.part /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f.converted" returned: 0 in 0.581s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f.converted --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Instance destroyed successfully.
Nov 14 19:32:39 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lazy-loading 'resources' on Instance uuid 602429d1-cfd8-4984-97db-b086f9d1ecfd {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-8166094e-1a1b-4568-8e34-0162e6d109c1 req-5fc14603-3c24-4340-8d3a-207429b9fcd5 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-unplugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8166094e-1a1b-4568-8e34-0162e6d109c1 req-5fc14603-3c24-4340-8d3a-207429b9fcd5 service nova] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8166094e-1a1b-4568-8e34-0162e6d109c1 req-5fc14603-3c24-4340-8d3a-207429b9fcd5 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8166094e-1a1b-4568-8e34-0162e6d109c1 req-5fc14603-3c24-4340-8d3a-207429b9fcd5 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-8166094e-1a1b-4568-8e34-0162e6d109c1 req-5fc14603-3c24-4340-8d3a-207429b9fcd5 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] No waiting events found dispatching network-vif-unplugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-8166094e-1a1b-4568-8e34-0162e6d109c1 req-5fc14603-3c24-4340-8d3a-207429b9fcd5 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-unplugged-85389b0d-a54a-48df-b551-f057e727cb4f for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-319623074',display_name='tempest-TestVolumeBootPattern-server-319623074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-319623074',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4lflwSUeyVbH81QiQ0Uh3cKzramHeRM7aduqUtZ4pb3+SjiUT5tItPthN7NGlihkCZ2OzXolgwmiBolVRT+jaN4ru1XGIc7ZtqCPOyOWGe8i2eYeT/Jps/FMv13SMF/w==',key_name='tempest-TestVolumeBootPattern-186737572',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fe039dc34949509e4ad72cd9da3bf1',ramdisk_id='',reservation_id='r-bsvta9p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-397278786',owner_user_name='tempest-TestVolumeBootPattern-397278786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:28:04Z,user_data=None,user_id='06b3b7a0f2ae441f8cb1d50891fcab94',uuid=602429d1-cfd8-4984-97db-b086f9d1ecfd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converting VIF {"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:6d:ba,bridge_name='br-int',has_traffic_filtering=True,id=85389b0d-a54a-48df-b551-f057e727cb4f,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85389b0d-a5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_vif [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:6d:ba,bridge_name='br-int',has_traffic_filtering=True,id=85389b0d-a54a-48df-b551-f057e727cb4f,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85389b0d-a5') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85389b0d-a5, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "786f982d08a24e7900db4432ce3f0e84634fa07f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfbf4205-74cc-45b1-845f-f925a112d7b0) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:32:40 user nova-compute[75205]: INFO os_vif [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:6d:ba,bridge_name='br-int',has_traffic_filtering=True,id=85389b0d-a54a-48df-b551-f057e727cb4f,network=Network(cc825dc5-8329-4dd9-95cc-d79339b133f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85389b0d-a5')
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EiByouVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:32:40 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[246414b8-3ff5-4d39-844b-3332087e66d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:32:40 user nova-compute[75205]: No targets found.
Nov 14 19:32:40 user nova-compute[75205]: iSNS:
Nov 14 19:32:40 user nova-compute[75205]: No targets found.
Nov 14 19:32:40 user nova-compute[75205]: STATIC:
Nov 14 19:32:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a
Nov 14 19:32:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:32:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:32:40 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c
Nov 14 19:32:40 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:32:40 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:32:40 user nova-compute[75205]: FIRMWARE:
Nov 14 19:32:40 user nova-compute[75205]: No targets found.
Nov 14 19:32:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:32:40 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:32:40 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed74dfc-933e-4698-bb3f-321c5305c9ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aaf888-2c02-4dbe-b84c-aedb18492149]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:32:40 user nova-compute[75205]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:32:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c (non-flash)
Nov 14 19:32:40 user nova-compute[75205]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:32:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb547d5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f --force-share --output=json" returned: 0 in 0.253s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "786f982d08a24e7900db4432ce3f0e84634fa07f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "786f982d08a24e7900db4432ce3f0e84634fa07f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.network.neutron [req-b592670c-921f-48dc-b7ec-c8830bbdcf5d req-4def21bc-81e4-4407-90f5-737d40dd385e service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Updated VIF entry in instance network info cache for port 85389b0d-a54a-48df-b551-f057e727cb4f. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.network.neutron [req-b592670c-921f-48dc-b7ec-c8830bbdcf5d req-4def21bc-81e4-4407-90f5-737d40dd385e service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Updating instance_info_cache with network_info: [{"id": "85389b0d-a54a-48df-b551-f057e727cb4f", "address": "fa:16:3e:86:6d:ba", "network": {"id": "cc825dc5-8329-4dd9-95cc-d79339b133f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-750575725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fe039dc34949509e4ad72cd9da3bf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85389b0d-a5", "ovs_interfaceid": "85389b0d-a54a-48df-b551-f057e727cb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[326c3d7b-8312-43ef-91d3-b3480b889ad4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[854ef8e2-c095-4f8e-b4a2-c3a1d0688377]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b592670c-921f-48dc-b7ec-c8830bbdcf5d req-4def21bc-81e4-4407-90f5-737d40dd385e service nova] Releasing lock "refresh_cache-602429d1-cfd8-4984-97db-b086f9d1ecfd" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a71191-4ac5-407d-a8bb-2556afb8cdaf]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.077s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c626db-c1a8-4b3e-9a5a-ce778a62cffa]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf68147f-5fdb-4df0-9125-af5c2dec71b6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f --force-share --output=json" returned: 0 in 0.330s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f,backing_fmt=raw /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f,backing_fmt=raw /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk 1073741824" returned: 0 in 0.069s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "786f982d08a24e7900db4432ce3f0e84634fa07f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.406s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a4a246-c98a-4800-ba86-aa48e3d549d1]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260]
Nov 14 19:32:40 user nova-compute[75205]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c, portal: 172.16.0.220,3260] successful.
Nov 14 19:32:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5384e6fc-7619-469f-8b8d-0a8cfdaa350c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cad2fcb-557e-4d1d-a3dd-b2e2841bc259]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.632s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] <== disconnect_volume: return (640ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:32:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Deleting instance files /opt/stack/data/nova/instances/602429d1-cfd8-4984-97db-b086f9d1ecfd_del
Nov 14 19:32:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Deletion of /opt/stack/data/nova/instances/602429d1-cfd8-4984-97db-b086f9d1ecfd_del complete
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'migration_context' on Instance uuid 22b41998-e98e-4797-b28d-db091cea8112 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.objects.base [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Object Instance<22b41998-e98e-4797-b28d-db091cea8112> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:32:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Rebasing disk image.
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:40 user nova-compute[75205]: INFO nova.compute.manager [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Took 1.82 seconds to destroy the instance on the hypervisor.
Nov 14 19:32:40 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:32:40 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:32:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.215s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de -F raw /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:41 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:32:41 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Took 0.74 seconds to deallocate network for instance.
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] No waiting events found dispatching network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:42 user nova-compute[75205]: WARNING nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received unexpected event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f for instance with vm_state active and task_state deleting.
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] No waiting events found dispatching network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:42 user nova-compute[75205]: WARNING nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received unexpected event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f for instance with vm_state active and task_state deleting.
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] No waiting events found dispatching network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:42 user nova-compute[75205]: WARNING nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received unexpected event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f for instance with vm_state active and task_state deleting.
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-unplugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] No waiting events found dispatching network-vif-unplugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-unplugged-85389b0d-a54a-48df-b551-f057e727cb4f for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Acquiring lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] No waiting events found dispatching network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:42 user nova-compute[75205]: WARNING nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received unexpected event network-vif-plugged-85389b0d-a54a-48df-b551-f057e727cb4f for instance with vm_state active and task_state deleting.
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-69e27869-ddfb-4d31-9aa6-3102661ac869 req-935c676a-8c5a-4c60-a704-2a9242a9b7c1 service nova] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Received event network-vif-deleted-85389b0d-a54a-48df-b551-f057e727cb4f {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:32:42 user nova-compute[75205]: INFO nova.compute.manager [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] [instance: 602429d1-cfd8-4984-97db-b086f9d1ecfd] Took 1.00 seconds to detach 1 volumes for instance.
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:32:42 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:43 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Deleted allocations for instance 602429d1-cfd8-4984-97db-b086f9d1ecfd
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e382fb98-d66f-4b2e-82d4-3cd8b3d42d82 tempest-TestVolumeBootPattern-397278786 tempest-TestVolumeBootPattern-397278786-project-member] Lock "602429d1-cfd8-4984-97db-b086f9d1ecfd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.073s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de -F raw /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk" returned: 0 in 2.652s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Ensure instance console log exists: /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Start _get_guest_xml network_info=[{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='dd3789257dcbe2951d9cd233f9b5b1cd',container_format='bare',created_at=2023-11-14T19:30:43Z,direct_url=<?>,disk_format='qcow2',id=f87898b4-f42f-4290-aca9-0807295af038,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-948750380-shelved',owner='1bce9c4222254fe688cb54f69fe7bc4a',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T19:30:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:32:43 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:32:43 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8571MB free_disk=25.05316925048828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:43 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:32:43 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='dd3789257dcbe2951d9cd233f9b5b1cd',container_format='bare',created_at=2023-11-14T19:30:43Z,direct_url=<?>,disk_format='qcow2',id=f87898b4-f42f-4290-aca9-0807295af038,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-948750380-shelved',owner='1bce9c4222254fe688cb54f69fe7bc4a',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T19:30:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'vcpu_model' on Instance uuid 22b41998-e98e-4797-b28d-db091cea8112 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.objects.base [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Object Instance<22b41998-e98e-4797-b28d-db091cea8112> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948750380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948750380',id=40,image_ref='f87898b4-f42f-4290-aca9-0807295af038',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1858313542',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:28:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-9kjdv1bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member',shelved_at='2023-11-14T19:30:47.326231',shelved_host='user',shelved_image_id='f87898b4-f42f-4290-aca9-0807295af038'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=22b41998-e98e-4797-b28d-db091cea8112,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'pci_devices' on Instance uuid 22b41998-e98e-4797-b28d-db091cea8112 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.objects.base [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Object Instance<22b41998-e98e-4797-b28d-db091cea8112> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:32:43 user nova-compute[75205]:   <uuid>22b41998-e98e-4797-b28d-db091cea8112</uuid>
Nov 14 19:32:43 user nova-compute[75205]:   <name>instance-00000028</name>
Nov 14 19:32:43 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:32:43 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:32:43 user nova-compute[75205]:   <metadata>
Nov 14 19:32:43 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:32:43 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:32:43 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-948750380</nova:name>
Nov 14 19:32:43 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:32:43</nova:creationTime>
Nov 14 19:32:43 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:32:43 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:32:43 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:32:43 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:32:43 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:32:43 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:32:43 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:32:43 user nova-compute[75205]:       <nova:owner>
Nov 14 19:32:43 user nova-compute[75205]:         <nova:user uuid="b3e0b9e41b584048ae0c868ec72e89a0">tempest-AttachVolumeShelveTestJSON-707756004-project-member</nova:user>
Nov 14 19:32:43 user nova-compute[75205]:         <nova:project uuid="1bce9c4222254fe688cb54f69fe7bc4a">tempest-AttachVolumeShelveTestJSON-707756004</nova:project>
Nov 14 19:32:43 user nova-compute[75205]:       </nova:owner>
Nov 14 19:32:43 user nova-compute[75205]:       <nova:root type="image" uuid="f87898b4-f42f-4290-aca9-0807295af038"/>
Nov 14 19:32:43 user nova-compute[75205]:       <nova:ports>
Nov 14 19:32:43 user nova-compute[75205]:         <nova:port uuid="59acb1f8-f517-493d-bab2-257903a6a353">
Nov 14 19:32:43 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 19:32:43 user nova-compute[75205]:         </nova:port>
Nov 14 19:32:43 user nova-compute[75205]:       </nova:ports>
Nov 14 19:32:43 user nova-compute[75205]:     </nova:instance>
Nov 14 19:32:43 user nova-compute[75205]:   </metadata>
Nov 14 19:32:43 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:32:43 user nova-compute[75205]:     <system>
Nov 14 19:32:43 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:32:43 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:32:43 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:32:43 user nova-compute[75205]:       <entry name="serial">22b41998-e98e-4797-b28d-db091cea8112</entry>
Nov 14 19:32:43 user nova-compute[75205]:       <entry name="uuid">22b41998-e98e-4797-b28d-db091cea8112</entry>
Nov 14 19:32:43 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:32:43 user nova-compute[75205]:     </system>
Nov 14 19:32:43 user nova-compute[75205]:   </sysinfo>
Nov 14 19:32:43 user nova-compute[75205]:   <os>
Nov 14 19:32:43 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:32:43 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:32:43 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:32:43 user nova-compute[75205]:   </os>
Nov 14 19:32:43 user nova-compute[75205]:   <features>
Nov 14 19:32:43 user nova-compute[75205]:     <acpi/>
Nov 14 19:32:43 user nova-compute[75205]:     <apic/>
Nov 14 19:32:43 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:32:43 user nova-compute[75205]:   </features>
Nov 14 19:32:43 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:32:43 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:32:43 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:32:43 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:32:43 user nova-compute[75205]:   </clock>
Nov 14 19:32:43 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:32:43 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:32:43 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:32:43 user nova-compute[75205]:   </cpu>
Nov 14 19:32:43 user nova-compute[75205]:   <devices>
Nov 14 19:32:43 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:32:43 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:32:43 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk"/>
Nov 14 19:32:43 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:32:43 user nova-compute[75205]:     </disk>
Nov 14 19:32:43 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:32:43 user nova-compute[75205]:       <mac address="fa:16:3e:d9:4e:bd"/>
Nov 14 19:32:43 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:32:43 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:32:43 user nova-compute[75205]:       <target dev="tap59acb1f8-f5"/>
Nov 14 19:32:43 user nova-compute[75205]:     </interface>
Nov 14 19:32:43 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:32:43 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/console.log" append="off"/>
Nov 14 19:32:43 user nova-compute[75205]:     </serial>
Nov 14 19:32:43 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:32:43 user nova-compute[75205]:     <video>
Nov 14 19:32:43 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:32:43 user nova-compute[75205]:     </video>
Nov 14 19:32:43 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:32:43 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:32:43 user nova-compute[75205]:     </rng>
Nov 14 19:32:43 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:32:43 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:32:43 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:32:43 user nova-compute[75205]:     </memballoon>
Nov 14 19:32:43 user nova-compute[75205]:   </devices>
Nov 14 19:32:43 user nova-compute[75205]: </domain>
Nov 14 19:32:43 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948750380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948750380',id=40,image_ref='f87898b4-f42f-4290-aca9-0807295af038',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1858313542',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:28:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-9kjdv1bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member',shelved_at='2023-11-14T19:30:47.326231',shelved_host='user',shelved_image_id='f87898b4-f42f-4290-aca9-0807295af038'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=22b41998-e98e-4797-b28d-db091cea8112,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG os_vif [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '928026ab-561d-565f-83cb-4377ae016afc', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59acb1f8-f5, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59acb1f8-f5, col_values=(('qos', UUID('9cf27728-c858-45fc-b500-773a6134e0c7')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59acb1f8-f5, col_values=(('external_ids', {'iface-id': '59acb1f8-f517-493d-bab2-257903a6a353', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:4e:bd', 'vm-uuid': '22b41998-e98e-4797-b28d-db091cea8112'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 298a5eb2-6362-40bd-93fa-2cad9b07718a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (7def1607-b7d5-4fc6-9f9d-da4f8e437fa8): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:43 user nova-compute[75205]: INFO os_vif [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5')
Nov 14 19:32:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:32:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] No VIF found with MAC fa:16:3e:d9:4e:bd, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:32:44 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:32:44 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:32:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:32:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-12c56e9c-57fa-4a39-a2cb-c85ce7fd86f0 req-8345fb6f-a327-4c45-a923-3b1063fc4257 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-12c56e9c-57fa-4a39-a2cb-c85ce7fd86f0 req-8345fb6f-a327-4c45-a923-3b1063fc4257 service nova] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-12c56e9c-57fa-4a39-a2cb-c85ce7fd86f0 req-8345fb6f-a327-4c45-a923-3b1063fc4257 service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-12c56e9c-57fa-4a39-a2cb-c85ce7fd86f0 req-8345fb6f-a327-4c45-a923-3b1063fc4257 service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:45 user nova-compute[75205]: DEBUG nova.compute.manager [req-12c56e9c-57fa-4a39-a2cb-c85ce7fd86f0 req-8345fb6f-a327-4c45-a923-3b1063fc4257 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] No waiting events found dispatching network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:45 user nova-compute[75205]: WARNING nova.compute.manager [req-12c56e9c-57fa-4a39-a2cb-c85ce7fd86f0 req-8345fb6f-a327-4c45-a923-3b1063fc4257 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received unexpected event network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 19:32:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updating instance_info_cache with network_info: [{"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-22b41998-e98e-4797-b28d-db091cea8112" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:32:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:32:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-df9e3507-7af0-4ba0-8284-e5160ce188f4 req-432d77b4-0d54-4881-a383-989c2d73fa61 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-df9e3507-7af0-4ba0-8284-e5160ce188f4 req-432d77b4-0d54-4881-a383-989c2d73fa61 service nova] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-df9e3507-7af0-4ba0-8284-e5160ce188f4 req-432d77b4-0d54-4881-a383-989c2d73fa61 service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-df9e3507-7af0-4ba0-8284-e5160ce188f4 req-432d77b4-0d54-4881-a383-989c2d73fa61 service nova] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:47 user nova-compute[75205]: DEBUG nova.compute.manager [req-df9e3507-7af0-4ba0-8284-e5160ce188f4 req-432d77b4-0d54-4881-a383-989c2d73fa61 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] No waiting events found dispatching network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:47 user nova-compute[75205]: WARNING nova.compute.manager [req-df9e3507-7af0-4ba0-8284-e5160ce188f4 req-432d77b4-0d54-4881-a383-989c2d73fa61 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received unexpected event network-vif-plugged-59acb1f8-f517-493d-bab2-257903a6a353 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 19:32:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:32:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:32:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance spawned successfully.
Nov 14 19:32:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:32:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cecffa11-15bd-413a-8054-bb33db54fc67 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "22b41998-e98e-4797-b28d-db091cea8112" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.739s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:32:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:51 user nova-compute[75205]: INFO nova.compute.manager [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Terminating instance
Nov 14 19:32:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-f77bb3c7-f6db-4c10-babb-ed9a690f8a09 req-72eb7ca1-2923-42c1-80b4-e06bf6529b70 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-vif-unplugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f77bb3c7-f6db-4c10-babb-ed9a690f8a09 req-72eb7ca1-2923-42c1-80b4-e06bf6529b70 service nova] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f77bb3c7-f6db-4c10-babb-ed9a690f8a09 req-72eb7ca1-2923-42c1-80b4-e06bf6529b70 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f77bb3c7-f6db-4c10-babb-ed9a690f8a09 req-72eb7ca1-2923-42c1-80b4-e06bf6529b70 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-f77bb3c7-f6db-4c10-babb-ed9a690f8a09 req-72eb7ca1-2923-42c1-80b4-e06bf6529b70 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] No waiting events found dispatching network-vif-unplugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-f77bb3c7-f6db-4c10-babb-ed9a690f8a09 req-72eb7ca1-2923-42c1-80b4-e06bf6529b70 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-vif-unplugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Instance destroyed successfully.
Nov 14 19:32:52 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'resources' on Instance uuid 298a5eb2-6362-40bd-93fa-2cad9b07718a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-120934111',display_name='tempest-ServerActionsTestOtherA-server-120934111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-120934111',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3OJYMfErFiTGe/qVImPNNpMoleZ3J9mAlhBnKRLLztrPxOuSUjWBVerPUHNAmA4WwUUZXCuLX5O2r/5K813hJJaeAm4LX+jg/1ArdxTUJxjig4g1+w8aJwtp9ZiKaoQA==',key_name='tempest-keypair-1933539898',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:28:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-4ckfg9fe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=298a5eb2-6362-40bd-93fa-2cad9b07718a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "address": "fa:16:3e:68:ac:59", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb852cc39-4e", "ovs_interfaceid": "b852cc39-4e71-4a5e-bbbd-6dfd30715442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_vif [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb852cc39-4e, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3110651e-a4f7-4687-a80f-be430bff06eb) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:52 user nova-compute[75205]: INFO os_vif [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:ac:59,bridge_name='br-int',has_traffic_filtering=True,id=b852cc39-4e71-4a5e-bbbd-6dfd30715442,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb852cc39-4e')
Nov 14 19:32:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vImMOBrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:32:52 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5466bb27-abad-484f-af96-31750875d8ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:32:52 user nova-compute[75205]: No targets found.
Nov 14 19:32:52 user nova-compute[75205]: iSNS:
Nov 14 19:32:52 user nova-compute[75205]: No targets found.
Nov 14 19:32:52 user nova-compute[75205]: STATIC:
Nov 14 19:32:52 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a
Nov 14 19:32:52 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:32:52 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:32:52 user nova-compute[75205]: FIRMWARE:
Nov 14 19:32:52 user nova-compute[75205]: No targets found.
Nov 14 19:32:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:32:52 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:32:52 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6144746a-3957-4b61-b6ce-e81137541f77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0701bdbb-23ad-46bb-ab46-5a854d35c298]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:32:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a (non-flash)
Nov 14 19:32:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c260ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba981e9-8d4a-43a5-81a9-50034e1d5484]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[39195549-7a68-4421-9868-047a1e342dc5]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a0589d-a666-4ca7-bd95-81242fe6837d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[03861922-3e90-4154-935a-de9a151b8409]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8c19fcc3-fea06290435d6a4f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8c19fcc3', '/dev/disk/by-id/scsi-26665613036323930') {{(pid=85714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f808575-56db-488e-a89a-b0b63a835ec2]: (4, None) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7965d7-8468-457b-96f0-2ce9e06b9cfd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d243bfc-d73b-4382-9bbf-e5d57b0d32ff]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260]
Nov 14 19:32:52 user nova-compute[75205]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a, portal: 172.16.0.220,3260] successful.
Nov 14 19:32:52 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788c1a35-e7c1-4da1-b718-549567f2da3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f59c3c7-36b2-4d34-b5fb-1f70cc5bc8ab]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] <== disconnect_volume: return (345ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:32:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Deleting instance files /opt/stack/data/nova/instances/298a5eb2-6362-40bd-93fa-2cad9b07718a_del
Nov 14 19:32:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Deletion of /opt/stack/data/nova/instances/298a5eb2-6362-40bd-93fa-2cad9b07718a_del complete
Nov 14 19:32:52 user nova-compute[75205]: INFO nova.compute.manager [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 19:32:52 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:32:52 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:32:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-08dccbb8-04d5-4601-8055-b53925259754 req-98e046c4-f19f-48cb-b2fc-8f1407fc6cd1 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-08dccbb8-04d5-4601-8055-b53925259754 req-98e046c4-f19f-48cb-b2fc-8f1407fc6cd1 service nova] Acquiring lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-08dccbb8-04d5-4601-8055-b53925259754 req-98e046c4-f19f-48cb-b2fc-8f1407fc6cd1 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-08dccbb8-04d5-4601-8055-b53925259754 req-98e046c4-f19f-48cb-b2fc-8f1407fc6cd1 service nova] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-08dccbb8-04d5-4601-8055-b53925259754 req-98e046c4-f19f-48cb-b2fc-8f1407fc6cd1 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] No waiting events found dispatching network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:32:53 user nova-compute[75205]: WARNING nova.compute.manager [req-08dccbb8-04d5-4601-8055-b53925259754 req-98e046c4-f19f-48cb-b2fc-8f1407fc6cd1 service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received unexpected event network-vif-plugged-b852cc39-4e71-4a5e-bbbd-6dfd30715442 for instance with vm_state active and task_state deleting.
Nov 14 19:32:53 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:32:53 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Took 1.25 seconds to deallocate network for instance.
Nov 14 19:32:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-469ae080-c475-4dd6-9891-ab6b8c464b24 req-e4705bb9-1eb3-4d9f-af89-afc1832f5aed service nova] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Received event network-vif-deleted-b852cc39-4e71-4a5e-bbbd-6dfd30715442 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:32:54 user nova-compute[75205]: INFO nova.compute.manager [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Took 0.83 seconds to detach 1 volumes for instance.
Nov 14 19:32:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 298a5eb2-6362-40bd-93fa-2cad9b07718a] Deleting volume: 788c1a35-e7c1-4da1-b718-549567f2da3a {{(pid=75205) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 19:32:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:32:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:32:54 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:32:55 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:32:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:55 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Deleted allocations for instance 298a5eb2-6362-40bd-93fa-2cad9b07718a
Nov 14 19:32:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f57778a7-899a-40ed-b534-05269de73515 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "298a5eb2-6362-40bd-93fa-2cad9b07718a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.862s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:32:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:32:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:32:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "d9701a07-02df-476e-8621-caedcfc72c4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "d9701a07-02df-476e-8621-caedcfc72c4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:33:02 user nova-compute[75205]: INFO nova.compute.claims [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Claim successful on node user
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:33:02 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.policy [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc437e677797481d8ab81298fb5404ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68806249c8994e92aa504fe2458bbfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:33:02 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Creating image(s)
Nov 14 19:33:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "/opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "/opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:02 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Successfully created port: 9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk 1073741824" returned: 0 in 0.052s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.190s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Cannot resize image /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Ensure instance console log exists: /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Successfully updated port: 9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "refresh_cache-d9701a07-02df-476e-8621-caedcfc72c4e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquired lock "refresh_cache-d9701a07-02df-476e-8621-caedcfc72c4e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-e866ebcf-00bb-48bf-993e-39ebcedced21 req-82bb2ce9-76a0-4283-a924-3406bc005b8d service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Received event network-changed-9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-e866ebcf-00bb-48bf-993e-39ebcedced21 req-82bb2ce9-76a0-4283-a924-3406bc005b8d service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Refreshing instance network info cache due to event network-changed-9ba5fa49-540d-4842-a325-4ccf5ba78e52. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e866ebcf-00bb-48bf-993e-39ebcedced21 req-82bb2ce9-76a0-4283-a924-3406bc005b8d service nova] Acquiring lock "refresh_cache-d9701a07-02df-476e-8621-caedcfc72c4e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:33:03 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Updating instance_info_cache with network_info: [{"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Releasing lock "refresh_cache-d9701a07-02df-476e-8621-caedcfc72c4e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Instance network_info: |[{"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e866ebcf-00bb-48bf-993e-39ebcedced21 req-82bb2ce9-76a0-4283-a924-3406bc005b8d service nova] Acquired lock "refresh_cache-d9701a07-02df-476e-8621-caedcfc72c4e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.network.neutron [req-e866ebcf-00bb-48bf-993e-39ebcedced21 req-82bb2ce9-76a0-4283-a924-3406bc005b8d service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Refreshing network info cache for port 9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Start _get_guest_xml network_info=[{"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:33:04 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:33:04 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-169056188',display_name='tempest-VolumesActionsTest-instance-169056188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-169056188',id=44,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68806249c8994e92aa504fe2458bbfa5',ramdisk_id='',reservation_id='r-u37aus9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1905321778',owner_user_name='tempest-VolumesActionsTest-1905321778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:33:03Z,user_data=None,user_id='bc437e677797481d8ab81298fb5404ef',uuid=d9701a07-02df-476e-8621-caedcfc72c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converting VIF {"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fa:c6,bridge_name='br-int',has_traffic_filtering=True,id=9ba5fa49-540d-4842-a325-4ccf5ba78e52,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba5fa49-54') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.objects.instance [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lazy-loading 'pci_devices' on Instance uuid d9701a07-02df-476e-8621-caedcfc72c4e {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:33:04 user nova-compute[75205]:   <uuid>d9701a07-02df-476e-8621-caedcfc72c4e</uuid>
Nov 14 19:33:04 user nova-compute[75205]:   <name>instance-0000002c</name>
Nov 14 19:33:04 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:33:04 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:33:04 user nova-compute[75205]:   <metadata>
Nov 14 19:33:04 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:33:04 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:33:04 user nova-compute[75205]:       <nova:name>tempest-VolumesActionsTest-instance-169056188</nova:name>
Nov 14 19:33:04 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:33:04</nova:creationTime>
Nov 14 19:33:04 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:33:04 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:33:04 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:33:04 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:33:04 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:33:04 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:33:04 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:33:04 user nova-compute[75205]:       <nova:owner>
Nov 14 19:33:04 user nova-compute[75205]:         <nova:user uuid="bc437e677797481d8ab81298fb5404ef">tempest-VolumesActionsTest-1905321778-project-member</nova:user>
Nov 14 19:33:04 user nova-compute[75205]:         <nova:project uuid="68806249c8994e92aa504fe2458bbfa5">tempest-VolumesActionsTest-1905321778</nova:project>
Nov 14 19:33:04 user nova-compute[75205]:       </nova:owner>
Nov 14 19:33:04 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:33:04 user nova-compute[75205]:       <nova:ports>
Nov 14 19:33:04 user nova-compute[75205]:         <nova:port uuid="9ba5fa49-540d-4842-a325-4ccf5ba78e52">
Nov 14 19:33:04 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 19:33:04 user nova-compute[75205]:         </nova:port>
Nov 14 19:33:04 user nova-compute[75205]:       </nova:ports>
Nov 14 19:33:04 user nova-compute[75205]:     </nova:instance>
Nov 14 19:33:04 user nova-compute[75205]:   </metadata>
Nov 14 19:33:04 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:33:04 user nova-compute[75205]:     <system>
Nov 14 19:33:04 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:33:04 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:33:04 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:33:04 user nova-compute[75205]:       <entry name="serial">d9701a07-02df-476e-8621-caedcfc72c4e</entry>
Nov 14 19:33:04 user nova-compute[75205]:       <entry name="uuid">d9701a07-02df-476e-8621-caedcfc72c4e</entry>
Nov 14 19:33:04 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:33:04 user nova-compute[75205]:     </system>
Nov 14 19:33:04 user nova-compute[75205]:   </sysinfo>
Nov 14 19:33:04 user nova-compute[75205]:   <os>
Nov 14 19:33:04 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:33:04 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:33:04 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:33:04 user nova-compute[75205]:   </os>
Nov 14 19:33:04 user nova-compute[75205]:   <features>
Nov 14 19:33:04 user nova-compute[75205]:     <acpi/>
Nov 14 19:33:04 user nova-compute[75205]:     <apic/>
Nov 14 19:33:04 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:33:04 user nova-compute[75205]:   </features>
Nov 14 19:33:04 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:33:04 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:33:04 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:33:04 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:33:04 user nova-compute[75205]:   </clock>
Nov 14 19:33:04 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:33:04 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:33:04 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:33:04 user nova-compute[75205]:   </cpu>
Nov 14 19:33:04 user nova-compute[75205]:   <devices>
Nov 14 19:33:04 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:33:04 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:33:04 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk"/>
Nov 14 19:33:04 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:33:04 user nova-compute[75205]:     </disk>
Nov 14 19:33:04 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:33:04 user nova-compute[75205]:       <mac address="fa:16:3e:e7:fa:c6"/>
Nov 14 19:33:04 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:33:04 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:33:04 user nova-compute[75205]:       <target dev="tap9ba5fa49-54"/>
Nov 14 19:33:04 user nova-compute[75205]:     </interface>
Nov 14 19:33:04 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:33:04 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/console.log" append="off"/>
Nov 14 19:33:04 user nova-compute[75205]:     </serial>
Nov 14 19:33:04 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:33:04 user nova-compute[75205]:     <video>
Nov 14 19:33:04 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:33:04 user nova-compute[75205]:     </video>
Nov 14 19:33:04 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:33:04 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:33:04 user nova-compute[75205]:     </rng>
Nov 14 19:33:04 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:33:04 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:33:04 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:33:04 user nova-compute[75205]:     </memballoon>
Nov 14 19:33:04 user nova-compute[75205]:   </devices>
Nov 14 19:33:04 user nova-compute[75205]: </domain>
Nov 14 19:33:04 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-169056188',display_name='tempest-VolumesActionsTest-instance-169056188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-169056188',id=44,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68806249c8994e92aa504fe2458bbfa5',ramdisk_id='',reservation_id='r-u37aus9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1905321778',owner_user_name='tempest-VolumesActionsTest-1905321778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:33:03Z,user_data=None,user_id='bc437e677797481d8ab81298fb5404ef',uuid=d9701a07-02df-476e-8621-caedcfc72c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converting VIF {"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fa:c6,bridge_name='br-int',has_traffic_filtering=True,id=9ba5fa49-540d-4842-a325-4ccf5ba78e52,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba5fa49-54') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG os_vif [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fa:c6,bridge_name='br-int',has_traffic_filtering=True,id=9ba5fa49-540d-4842-a325-4ccf5ba78e52,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba5fa49-54') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52647c2a-4428-5e04-8466-ed0eb04460fc', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ba5fa49-54, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ba5fa49-54, col_values=(('qos', UUID('67b1ea83-030c-4738-838f-9ed694f3eb0a')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ba5fa49-54, col_values=(('external_ids', {'iface-id': '9ba5fa49-540d-4842-a325-4ccf5ba78e52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:fa:c6', 'vm-uuid': 'd9701a07-02df-476e-8621-caedcfc72c4e'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:04 user nova-compute[75205]: INFO os_vif [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fa:c6,bridge_name='br-int',has_traffic_filtering=True,id=9ba5fa49-540d-4842-a325-4ccf5ba78e52,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba5fa49-54')
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] No VIF found with MAC fa:16:3e:e7:fa:c6, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.network.neutron [req-e866ebcf-00bb-48bf-993e-39ebcedced21 req-82bb2ce9-76a0-4283-a924-3406bc005b8d service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Updated VIF entry in instance network info cache for port 9ba5fa49-540d-4842-a325-4ccf5ba78e52. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG nova.network.neutron [req-e866ebcf-00bb-48bf-993e-39ebcedced21 req-82bb2ce9-76a0-4283-a924-3406bc005b8d service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Updating instance_info_cache with network_info: [{"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:33:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e866ebcf-00bb-48bf-993e-39ebcedced21 req-82bb2ce9-76a0-4283-a924-3406bc005b8d service nova] Releasing lock "refresh_cache-d9701a07-02df-476e-8621-caedcfc72c4e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:33:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-049db5f9-3ae6-492a-8319-1b7708ae71c9 req-130852ca-7d93-42f2-8cfb-4861ad7109c2 service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Received event network-vif-plugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:33:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-049db5f9-3ae6-492a-8319-1b7708ae71c9 req-130852ca-7d93-42f2-8cfb-4861ad7109c2 service nova] Acquiring lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-049db5f9-3ae6-492a-8319-1b7708ae71c9 req-130852ca-7d93-42f2-8cfb-4861ad7109c2 service nova] Lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-049db5f9-3ae6-492a-8319-1b7708ae71c9 req-130852ca-7d93-42f2-8cfb-4861ad7109c2 service nova] Lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-049db5f9-3ae6-492a-8319-1b7708ae71c9 req-130852ca-7d93-42f2-8cfb-4861ad7109c2 service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] No waiting events found dispatching network-vif-plugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:33:06 user nova-compute[75205]: WARNING nova.compute.manager [req-049db5f9-3ae6-492a-8319-1b7708ae71c9 req-130852ca-7d93-42f2-8cfb-4861ad7109c2 service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Received unexpected event network-vif-plugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 for instance with vm_state building and task_state spawning.
Nov 14 19:33:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:33:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:33:07 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Instance spawned successfully.
Nov 14 19:33:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:33:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:07 user nova-compute[75205]: INFO nova.compute.manager [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 14 19:33:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:33:07 user nova-compute[75205]: INFO nova.compute.manager [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Took 5.45 seconds to build instance.
Nov 14 19:33:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a63bde97-6516-4404-9402-d46e22b881f9 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "d9701a07-02df-476e-8621-caedcfc72c4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.559s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b77b114f-6eca-4115-801e-d680d15868a1 req-1caeca1b-51e0-4d95-9038-3a9070fc45aa service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Received event network-vif-plugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:33:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b77b114f-6eca-4115-801e-d680d15868a1 req-1caeca1b-51e0-4d95-9038-3a9070fc45aa service nova] Acquiring lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b77b114f-6eca-4115-801e-d680d15868a1 req-1caeca1b-51e0-4d95-9038-3a9070fc45aa service nova] Lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b77b114f-6eca-4115-801e-d680d15868a1 req-1caeca1b-51e0-4d95-9038-3a9070fc45aa service nova] Lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:08 user nova-compute[75205]: DEBUG nova.compute.manager [req-b77b114f-6eca-4115-801e-d680d15868a1 req-1caeca1b-51e0-4d95-9038-3a9070fc45aa service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] No waiting events found dispatching network-vif-plugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:33:08 user nova-compute[75205]: WARNING nova.compute.manager [req-b77b114f-6eca-4115-801e-d680d15868a1 req-1caeca1b-51e0-4d95-9038-3a9070fc45aa service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Received unexpected event network-vif-plugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 for instance with vm_state active and task_state None.
Nov 14 19:33:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:40 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:33:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:33:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:33:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:40 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:33:40 user nova-compute[75205]: INFO nova.compute.claims [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Claim successful on node user
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:33:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.policy [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73896b6e82ec4503b7ade30ad9174619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76b8a1d6f4df4ad01e87a8bcf1e5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:33:41 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Creating image(s)
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "/opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "/opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "/opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk 1073741824" returned: 0 in 0.053s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Successfully created port: fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:33:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Cannot resize image /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Ensure instance console log exists: /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Successfully updated port: fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "refresh_cache-da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquired lock "refresh_cache-da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-328507d3-f944-404b-820d-8fae88b61474 req-e3d7c633-7e98-48e1-803b-f26594b02405 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received event network-changed-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-328507d3-f944-404b-820d-8fae88b61474 req-e3d7c633-7e98-48e1-803b-f26594b02405 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Refreshing instance network info cache due to event network-changed-fa96cb5c-0ee0-464c-b53c-4a34e62147a2. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-328507d3-f944-404b-820d-8fae88b61474 req-e3d7c633-7e98-48e1-803b-f26594b02405 service nova] Acquiring lock "refresh_cache-da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Updating instance_info_cache with network_info: [{"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Releasing lock "refresh_cache-da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Instance network_info: |[{"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-328507d3-f944-404b-820d-8fae88b61474 req-e3d7c633-7e98-48e1-803b-f26594b02405 service nova] Acquired lock "refresh_cache-da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.network.neutron [req-328507d3-f944-404b-820d-8fae88b61474 req-e3d7c633-7e98-48e1-803b-f26594b02405 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Refreshing network info cache for port fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:33:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Start _get_guest_xml network_info=[{"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:33:42 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:33:42 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-371088609',display_name='tempest-VolumesSnapshotTestJSON-instance-371088609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-371088609',id=45,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXAinOIECWzW3RvjLJON32ZyxaTyX7dqfRhYHm88qnv0SsDjG0Nk+Ra5p1oZqIihJbTw77MyuDDsY8glAyPlaQYmtYDngQG7aWBnoAqPzgpKJiQNfb3LjTHSB7nadVDXw==',key_name='tempest-keypair-369455307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6e76b8a1d6f4df4ad01e87a8bcf1e5d',ramdisk_id='',reservation_id='r-l0uxx180',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-880704583',owner_user_name='tempest-VolumesSnapshotTestJSON-880704583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73896b6e82ec4503b7ade30ad9174619',uuid=da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converting VIF {"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:3a:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa96cb5c-0ee0-464c-b53c-4a34e62147a2,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa96cb5c-0e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lazy-loading 'pci_devices' on Instance uuid da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:33:43 user nova-compute[75205]:   <uuid>da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9</uuid>
Nov 14 19:33:43 user nova-compute[75205]:   <name>instance-0000002d</name>
Nov 14 19:33:43 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:33:43 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:33:43 user nova-compute[75205]:   <metadata>
Nov 14 19:33:43 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:33:43 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:33:43 user nova-compute[75205]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-371088609</nova:name>
Nov 14 19:33:43 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:33:42</nova:creationTime>
Nov 14 19:33:43 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:33:43 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:33:43 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:33:43 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:33:43 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:33:43 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:33:43 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:33:43 user nova-compute[75205]:       <nova:owner>
Nov 14 19:33:43 user nova-compute[75205]:         <nova:user uuid="73896b6e82ec4503b7ade30ad9174619">tempest-VolumesSnapshotTestJSON-880704583-project-member</nova:user>
Nov 14 19:33:43 user nova-compute[75205]:         <nova:project uuid="e6e76b8a1d6f4df4ad01e87a8bcf1e5d">tempest-VolumesSnapshotTestJSON-880704583</nova:project>
Nov 14 19:33:43 user nova-compute[75205]:       </nova:owner>
Nov 14 19:33:43 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:33:43 user nova-compute[75205]:       <nova:ports>
Nov 14 19:33:43 user nova-compute[75205]:         <nova:port uuid="fa96cb5c-0ee0-464c-b53c-4a34e62147a2">
Nov 14 19:33:43 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:33:43 user nova-compute[75205]:         </nova:port>
Nov 14 19:33:43 user nova-compute[75205]:       </nova:ports>
Nov 14 19:33:43 user nova-compute[75205]:     </nova:instance>
Nov 14 19:33:43 user nova-compute[75205]:   </metadata>
Nov 14 19:33:43 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:33:43 user nova-compute[75205]:     <system>
Nov 14 19:33:43 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:33:43 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:33:43 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:33:43 user nova-compute[75205]:       <entry name="serial">da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9</entry>
Nov 14 19:33:43 user nova-compute[75205]:       <entry name="uuid">da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9</entry>
Nov 14 19:33:43 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:33:43 user nova-compute[75205]:     </system>
Nov 14 19:33:43 user nova-compute[75205]:   </sysinfo>
Nov 14 19:33:43 user nova-compute[75205]:   <os>
Nov 14 19:33:43 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:33:43 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:33:43 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:33:43 user nova-compute[75205]:   </os>
Nov 14 19:33:43 user nova-compute[75205]:   <features>
Nov 14 19:33:43 user nova-compute[75205]:     <acpi/>
Nov 14 19:33:43 user nova-compute[75205]:     <apic/>
Nov 14 19:33:43 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:33:43 user nova-compute[75205]:   </features>
Nov 14 19:33:43 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:33:43 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:33:43 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:33:43 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:33:43 user nova-compute[75205]:   </clock>
Nov 14 19:33:43 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:33:43 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:33:43 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:33:43 user nova-compute[75205]:   </cpu>
Nov 14 19:33:43 user nova-compute[75205]:   <devices>
Nov 14 19:33:43 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:33:43 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:33:43 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk"/>
Nov 14 19:33:43 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:33:43 user nova-compute[75205]:     </disk>
Nov 14 19:33:43 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:33:43 user nova-compute[75205]:       <mac address="fa:16:3e:10:3a:b5"/>
Nov 14 19:33:43 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:33:43 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:33:43 user nova-compute[75205]:       <target dev="tapfa96cb5c-0e"/>
Nov 14 19:33:43 user nova-compute[75205]:     </interface>
Nov 14 19:33:43 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:33:43 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/console.log" append="off"/>
Nov 14 19:33:43 user nova-compute[75205]:     </serial>
Nov 14 19:33:43 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:33:43 user nova-compute[75205]:     <video>
Nov 14 19:33:43 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:33:43 user nova-compute[75205]:     </video>
Nov 14 19:33:43 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:33:43 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:33:43 user nova-compute[75205]:     </rng>
Nov 14 19:33:43 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:33:43 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:33:43 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:33:43 user nova-compute[75205]:     </memballoon>
Nov 14 19:33:43 user nova-compute[75205]:   </devices>
Nov 14 19:33:43 user nova-compute[75205]: </domain>
Nov 14 19:33:43 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-371088609',display_name='tempest-VolumesSnapshotTestJSON-instance-371088609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-371088609',id=45,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXAinOIECWzW3RvjLJON32ZyxaTyX7dqfRhYHm88qnv0SsDjG0Nk+Ra5p1oZqIihJbTw77MyuDDsY8glAyPlaQYmtYDngQG7aWBnoAqPzgpKJiQNfb3LjTHSB7nadVDXw==',key_name='tempest-keypair-369455307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6e76b8a1d6f4df4ad01e87a8bcf1e5d',ramdisk_id='',reservation_id='r-l0uxx180',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-880704583',owner_user_name='tempest-VolumesSnapshotTestJSON-880704583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73896b6e82ec4503b7ade30ad9174619',uuid=da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converting VIF {"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:3a:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa96cb5c-0ee0-464c-b53c-4a34e62147a2,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa96cb5c-0e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG os_vif [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:3a:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa96cb5c-0ee0-464c-b53c-4a34e62147a2,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa96cb5c-0e') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16c36cc1-1683-5f34-b88b-7c7435b524f4', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa96cb5c-0e, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa96cb5c-0e, col_values=(('qos', UUID('81fe56f3-0399-4ec5-8833-03b0931f7bf9')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa96cb5c-0e, col_values=(('external_ids', {'iface-id': 'fa96cb5c-0ee0-464c-b53c-4a34e62147a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:3a:b5', 'vm-uuid': 'da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:43 user nova-compute[75205]: INFO os_vif [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:3a:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa96cb5c-0ee0-464c-b53c-4a34e62147a2,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa96cb5c-0e')
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] No VIF found with MAC fa:16:3e:10:3a:b5, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-328507d3-f944-404b-820d-8fae88b61474 req-e3d7c633-7e98-48e1-803b-f26594b02405 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Updated VIF entry in instance network info cache for port fa96cb5c-0ee0-464c-b53c-4a34e62147a2. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG nova.network.neutron [req-328507d3-f944-404b-820d-8fae88b61474 req-e3d7c633-7e98-48e1-803b-f26594b02405 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Updating instance_info_cache with network_info: [{"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-328507d3-f944-404b-820d-8fae88b61474 req-e3d7c633-7e98-48e1-803b-f26594b02405 service nova] Releasing lock "refresh_cache-da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:33:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:33:44 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:33:44 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=25.107620239257812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "934d0407-7d12-4edb-99d2-8558be6427d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "934d0407-7d12-4edb-99d2-8558be6427d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:44 user nova-compute[75205]: INFO nova.compute.manager [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Terminating instance
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 934d0407-7d12-4edb-99d2-8558be6427d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 22b41998-e98e-4797-b28d-db091cea8112 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d9701a07-02df-476e-8621-caedcfc72c4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-13612e94-4bb4-4c62-bae1-a46adad8372a req-13461605-7c82-4ce9-acc4-dbacf6b3d846 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received event network-vif-unplugged-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-13612e94-4bb4-4c62-bae1-a46adad8372a req-13461605-7c82-4ce9-acc4-dbacf6b3d846 service nova] Acquiring lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-13612e94-4bb4-4c62-bae1-a46adad8372a req-13461605-7c82-4ce9-acc4-dbacf6b3d846 service nova] Lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-13612e94-4bb4-4c62-bae1-a46adad8372a req-13461605-7c82-4ce9-acc4-dbacf6b3d846 service nova] Lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-13612e94-4bb4-4c62-bae1-a46adad8372a req-13461605-7c82-4ce9-acc4-dbacf6b3d846 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] No waiting events found dispatching network-vif-unplugged-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.manager [req-13612e94-4bb4-4c62-bae1-a46adad8372a req-13461605-7c82-4ce9-acc4-dbacf6b3d846 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received event network-vif-unplugged-b53ded48-7665-4249-884c-8c0938a57fa0 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:33:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Instance destroyed successfully.
Nov 14 19:33:45 user nova-compute[75205]: DEBUG nova.objects.instance [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lazy-loading 'resources' on Instance uuid 934d0407-7d12-4edb-99d2-8558be6427d6 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:14:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2026428892',display_name='tempest-ServerActionsTestOtherA-server-2026428892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2026428892',id=21,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3OJYMfErFiTGe/qVImPNNpMoleZ3J9mAlhBnKRLLztrPxOuSUjWBVerPUHNAmA4WwUUZXCuLX5O2r/5K813hJJaeAm4LX+jg/1ArdxTUJxjig4g1+w8aJwtp9ZiKaoQA==',key_name='tempest-keypair-1933539898',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:15:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55021da245654f6392681359d51cbc9d',ramdisk_id='',reservation_id='r-jrk0njx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-410645410',owner_user_name='tempest-ServerActionsTestOtherA-410645410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:15:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f89ca9b3c52040acbc46581ac5cf55b9',uuid=934d0407-7d12-4edb-99d2-8558be6427d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converting VIF {"id": "b53ded48-7665-4249-884c-8c0938a57fa0", "address": "fa:16:3e:b6:4f:58", "network": {"id": "65e15e2b-0a4a-42c1-bd8a-46fb0db8b845", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-217010368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55021da245654f6392681359d51cbc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53ded48-76", "ovs_interfaceid": "b53ded48-7665-4249-884c-8c0938a57fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:4f:58,bridge_name='br-int',has_traffic_filtering=True,id=b53ded48-7665-4249-884c-8c0938a57fa0,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53ded48-76') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG os_vif [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:4f:58,bridge_name='br-int',has_traffic_filtering=True,id=b53ded48-7665-4249-884c-8c0938a57fa0,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53ded48-76') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb53ded48-76, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88baefba-3078-43b0-9f45-e9180ca4868e) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:45 user nova-compute[75205]: INFO os_vif [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:4f:58,bridge_name='br-int',has_traffic_filtering=True,id=b53ded48-7665-4249-884c-8c0938a57fa0,network=Network(65e15e2b-0a4a-42c1-bd8a-46fb0db8b845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53ded48-76')
Nov 14 19:33:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Deleting instance files /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6_del
Nov 14 19:33:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Deletion of /opt/stack/data/nova/instances/934d0407-7d12-4edb-99d2-8558be6427d6_del complete
Nov 14 19:33:45 user nova-compute[75205]: INFO nova.compute.manager [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 14 19:33:45 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:33:45 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-0377b336-02a9-4af2-ac6e-28f41fc5f227 req-eb118f6d-b61e-4541-b1db-f8bc64556af1 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received event network-vif-deleted-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:33:46 user nova-compute[75205]: INFO nova.compute.manager [req-0377b336-02a9-4af2-ac6e-28f41fc5f227 req-eb118f6d-b61e-4541-b1db-f8bc64556af1 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Neutron deleted interface b53ded48-7665-4249-884c-8c0938a57fa0; detaching it from the instance and deleting it from the info cache
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.network.neutron [req-0377b336-02a9-4af2-ac6e-28f41fc5f227 req-eb118f6d-b61e-4541-b1db-f8bc64556af1 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-0377b336-02a9-4af2-ac6e-28f41fc5f227 req-eb118f6d-b61e-4541-b1db-f8bc64556af1 service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Detach interface failed, port_id=b53ded48-7665-4249-884c-8c0938a57fa0, reason: Instance 934d0407-7d12-4edb-99d2-8558be6427d6 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:33:46 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Took 0.63 seconds to deallocate network for instance.
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:46 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Deleted allocations for instance 934d0407-7d12-4edb-99d2-8558be6427d6
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-876aaf66-d5dd-4fcf-b463-9d1818e8b2b6 tempest-ServerActionsTestOtherA-410645410 tempest-ServerActionsTestOtherA-410645410-project-member] Lock "934d0407-7d12-4edb-99d2-8558be6427d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.122s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received event network-vif-plugged-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] Acquiring lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] Lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] Lock "934d0407-7d12-4edb-99d2-8558be6427d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] No waiting events found dispatching network-vif-plugged-b53ded48-7665-4249-884c-8c0938a57fa0 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:33:46 user nova-compute[75205]: WARNING nova.compute.manager [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] [instance: 934d0407-7d12-4edb-99d2-8558be6427d6] Received unexpected event network-vif-plugged-b53ded48-7665-4249-884c-8c0938a57fa0 for instance with vm_state deleted and task_state None.
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received event network-vif-plugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] No waiting events found dispatching network-vif-plugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:33:46 user nova-compute[75205]: WARNING nova.compute.manager [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received unexpected event network-vif-plugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 for instance with vm_state building and task_state spawning.
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received event network-vif-plugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] No waiting events found dispatching network-vif-plugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:33:46 user nova-compute[75205]: WARNING nova.compute.manager [req-89982b54-1ff4-4a20-8066-2411ea0548c1 req-6767ec17-9f01-450b-8215-4b3b70864b4c service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received unexpected event network-vif-plugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 for instance with vm_state building and task_state spawning.
Nov 14 19:33:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:33:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:33:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:33:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:33:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Instance spawned successfully.
Nov 14 19:33:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:33:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:33:47 user nova-compute[75205]: INFO nova.compute.manager [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 14 19:33:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:33:47 user nova-compute[75205]: INFO nova.compute.manager [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Took 6.60 seconds to build instance.
Nov 14 19:33:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8a230177-35dc-4c25-b088-d959ed6ec051 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.709s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:33:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:47 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:33:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:33:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:33:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:34:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "22b41998-e98e-4797-b28d-db091cea8112" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "22b41998-e98e-4797-b28d-db091cea8112-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "22b41998-e98e-4797-b28d-db091cea8112-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:26 user nova-compute[75205]: INFO nova.compute.manager [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Terminating instance
Nov 14 19:34:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:34:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:27 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Instance destroyed successfully.
Nov 14 19:34:27 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lazy-loading 'resources' on Instance uuid 22b41998-e98e-4797-b28d-db091cea8112 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T19:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948750380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948750380',id=40,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6NuEZLLKqjrnXTThDPmuk66mkWNn97l1L3F002JaTttyz5nOrN6mt3Nf9t7RNYYHJZFLY2/aIe4WNw25syEjYXJE259MN8mMXrHiRyQBeVh3lpD9FUpk1ebT2cG639ig==',key_name='tempest-keypair-1858313542',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:32:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bce9c4222254fe688cb54f69fe7bc4a',ramdisk_id='',reservation_id='r-9kjdv1bt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-707756004',owner_user_name='tempest-AttachVolumeShelveTestJSON-707756004-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:32:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3e0b9e41b584048ae0c868ec72e89a0',uuid=22b41998-e98e-4797-b28d-db091cea8112,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converting VIF {"id": "59acb1f8-f517-493d-bab2-257903a6a353", "address": "fa:16:3e:d9:4e:bd", "network": {"id": "4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1098685583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bce9c4222254fe688cb54f69fe7bc4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59acb1f8-f5", "ovs_interfaceid": "59acb1f8-f517-493d-bab2-257903a6a353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG os_vif [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59acb1f8-f5, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cf27728-c858-45fc-b500-773a6134e0c7) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:27 user nova-compute[75205]: INFO os_vif [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:4e:bd,bridge_name='br-int',has_traffic_filtering=True,id=59acb1f8-f517-493d-bab2-257903a6a353,network=Network(4ebbc83d-6bfe-4611-ab4f-4b6d10a803d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59acb1f8-f5')
Nov 14 19:34:27 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Deleting instance files /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112_del
Nov 14 19:34:27 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Deletion of /opt/stack/data/nova/instances/22b41998-e98e-4797-b28d-db091cea8112_del complete
Nov 14 19:34:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:27 user nova-compute[75205]: INFO nova.compute.manager [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 14 19:34:27 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:34:27 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 22b41998-e98e-4797-b28d-db091cea8112] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:34:28 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:34:28 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Took 0.79 seconds to deallocate network for instance.
Nov 14 19:34:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:28 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:34:28 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:34:28 user nova-compute[75205]: DEBUG nova.compute.manager [req-3379c76b-39ea-4df5-970a-939a2c931baa req-8566fddb-c260-4291-9a2e-c10cbbd44a88 service nova] [instance: 22b41998-e98e-4797-b28d-db091cea8112] Received event network-vif-deleted-59acb1f8-f517-493d-bab2-257903a6a353 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:34:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:28 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Deleted allocations for instance 22b41998-e98e-4797-b28d-db091cea8112
Nov 14 19:34:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3f78a40f-45e4-4414-9704-96c596476102 tempest-AttachVolumeShelveTestJSON-707756004 tempest-AttachVolumeShelveTestJSON-707756004-project-member] Lock "22b41998-e98e-4797-b28d-db091cea8112" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.226s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:32 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:34:37 user nova-compute[75205]: INFO nova.compute.claims [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Claim successful on node user
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:34:37 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.policy [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47e6f274df2942cca10a45372cc3fab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99733ea8356b43c3adda0df55c4d83fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:34:37 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Creating image(s)
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "/opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "/opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "/opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk 1073741824" returned: 0 in 0.209s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.392s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Successfully created port: 6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Cannot resize image /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Ensure instance console log exists: /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Successfully updated port: 6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquired lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-4113dfc8-88f7-4bfc-b5f8-31992712b002 req-5fbef9c2-3321-4569-a92d-720fbfd35204 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received event network-changed-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-4113dfc8-88f7-4bfc-b5f8-31992712b002 req-5fbef9c2-3321-4569-a92d-720fbfd35204 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Refreshing instance network info cache due to event network-changed-6a33d1ba-174c-4dc6-9b82-76c07db2aa28. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4113dfc8-88f7-4bfc-b5f8-31992712b002 req-5fbef9c2-3321-4569-a92d-720fbfd35204 service nova] Acquiring lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.neutron [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating instance_info_cache with network_info: [{"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Releasing lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Instance network_info: |[{"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4113dfc8-88f7-4bfc-b5f8-31992712b002 req-5fbef9c2-3321-4569-a92d-720fbfd35204 service nova] Acquired lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-4113dfc8-88f7-4bfc-b5f8-31992712b002 req-5fbef9c2-3321-4569-a92d-720fbfd35204 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Refreshing network info cache for port 6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Start _get_guest_xml network_info=[{"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:34:39 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:34:39 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:34:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1264497628',display_name='tempest-SnapshotDataIntegrityTests-server-1264497628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1264497628',id=46,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHK/N2x2dV5wpn3MqzUEd3aZ7sqIzeURLEsp3xqlM//iWAyOLOJMHPOtrxcS8j21X9WTAKY9x6t4uBdebhnG8lwA5gduTBJhnVnwVFK7P+0ndTHXI6fHGeh8x2ZzbsOnfA==',key_name='tempest-keypair-54726157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99733ea8356b43c3adda0df55c4d83fa',ramdisk_id='',reservation_id='r-bsg0ivjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1349380683',owner_user_name='tempest-SnapshotDataIntegrityTests-1349380683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:34:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47e6f274df2942cca10a45372cc3fab4',uuid=f308e6dd-371b-466a-88d4-1d186fef55d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Converting VIF {"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ac:75,bridge_name='br-int',has_traffic_filtering=True,id=6a33d1ba-174c-4dc6-9b82-76c07db2aa28,network=Network(c16b7124-e118-43f9-9cc8-baf4eda9ec31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a33d1ba-17') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'pci_devices' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:34:39 user nova-compute[75205]:   <uuid>f308e6dd-371b-466a-88d4-1d186fef55d3</uuid>
Nov 14 19:34:39 user nova-compute[75205]:   <name>instance-0000002e</name>
Nov 14 19:34:39 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:34:39 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:34:39 user nova-compute[75205]:   <metadata>
Nov 14 19:34:39 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:34:39 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:34:39 user nova-compute[75205]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1264497628</nova:name>
Nov 14 19:34:39 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:34:39</nova:creationTime>
Nov 14 19:34:39 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:34:39 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:34:39 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:34:39 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:34:39 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:34:39 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:34:39 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:34:39 user nova-compute[75205]:       <nova:owner>
Nov 14 19:34:39 user nova-compute[75205]:         <nova:user uuid="47e6f274df2942cca10a45372cc3fab4">tempest-SnapshotDataIntegrityTests-1349380683-project-member</nova:user>
Nov 14 19:34:39 user nova-compute[75205]:         <nova:project uuid="99733ea8356b43c3adda0df55c4d83fa">tempest-SnapshotDataIntegrityTests-1349380683</nova:project>
Nov 14 19:34:39 user nova-compute[75205]:       </nova:owner>
Nov 14 19:34:39 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:34:39 user nova-compute[75205]:       <nova:ports>
Nov 14 19:34:39 user nova-compute[75205]:         <nova:port uuid="6a33d1ba-174c-4dc6-9b82-76c07db2aa28">
Nov 14 19:34:39 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 19:34:39 user nova-compute[75205]:         </nova:port>
Nov 14 19:34:39 user nova-compute[75205]:       </nova:ports>
Nov 14 19:34:39 user nova-compute[75205]:     </nova:instance>
Nov 14 19:34:39 user nova-compute[75205]:   </metadata>
Nov 14 19:34:39 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:34:39 user nova-compute[75205]:     <system>
Nov 14 19:34:39 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:34:39 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:34:39 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:34:39 user nova-compute[75205]:       <entry name="serial">f308e6dd-371b-466a-88d4-1d186fef55d3</entry>
Nov 14 19:34:39 user nova-compute[75205]:       <entry name="uuid">f308e6dd-371b-466a-88d4-1d186fef55d3</entry>
Nov 14 19:34:39 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:34:39 user nova-compute[75205]:     </system>
Nov 14 19:34:39 user nova-compute[75205]:   </sysinfo>
Nov 14 19:34:39 user nova-compute[75205]:   <os>
Nov 14 19:34:39 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:34:39 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:34:39 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:34:39 user nova-compute[75205]:   </os>
Nov 14 19:34:39 user nova-compute[75205]:   <features>
Nov 14 19:34:39 user nova-compute[75205]:     <acpi/>
Nov 14 19:34:39 user nova-compute[75205]:     <apic/>
Nov 14 19:34:39 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:34:39 user nova-compute[75205]:   </features>
Nov 14 19:34:39 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:34:39 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:34:39 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:34:39 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:34:39 user nova-compute[75205]:   </clock>
Nov 14 19:34:39 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:34:39 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:34:39 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:34:39 user nova-compute[75205]:   </cpu>
Nov 14 19:34:39 user nova-compute[75205]:   <devices>
Nov 14 19:34:39 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:34:39 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:34:39 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk"/>
Nov 14 19:34:39 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:34:39 user nova-compute[75205]:     </disk>
Nov 14 19:34:39 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:34:39 user nova-compute[75205]:       <mac address="fa:16:3e:8c:ac:75"/>
Nov 14 19:34:39 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:34:39 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:34:39 user nova-compute[75205]:       <target dev="tap6a33d1ba-17"/>
Nov 14 19:34:39 user nova-compute[75205]:     </interface>
Nov 14 19:34:39 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:34:39 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/console.log" append="off"/>
Nov 14 19:34:39 user nova-compute[75205]:     </serial>
Nov 14 19:34:39 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:34:39 user nova-compute[75205]:     <video>
Nov 14 19:34:39 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:34:39 user nova-compute[75205]:     </video>
Nov 14 19:34:39 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:34:39 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:34:39 user nova-compute[75205]:     </rng>
Nov 14 19:34:39 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:34:39 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:34:39 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:34:39 user nova-compute[75205]:     </memballoon>
Nov 14 19:34:39 user nova-compute[75205]:   </devices>
Nov 14 19:34:39 user nova-compute[75205]: </domain>
Nov 14 19:34:39 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:34:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1264497628',display_name='tempest-SnapshotDataIntegrityTests-server-1264497628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1264497628',id=46,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHK/N2x2dV5wpn3MqzUEd3aZ7sqIzeURLEsp3xqlM//iWAyOLOJMHPOtrxcS8j21X9WTAKY9x6t4uBdebhnG8lwA5gduTBJhnVnwVFK7P+0ndTHXI6fHGeh8x2ZzbsOnfA==',key_name='tempest-keypair-54726157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99733ea8356b43c3adda0df55c4d83fa',ramdisk_id='',reservation_id='r-bsg0ivjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1349380683',owner_user_name='tempest-SnapshotDataIntegrityTests-1349380683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:34:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47e6f274df2942cca10a45372cc3fab4',uuid=f308e6dd-371b-466a-88d4-1d186fef55d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Converting VIF {"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ac:75,bridge_name='br-int',has_traffic_filtering=True,id=6a33d1ba-174c-4dc6-9b82-76c07db2aa28,network=Network(c16b7124-e118-43f9-9cc8-baf4eda9ec31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a33d1ba-17') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG os_vif [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ac:75,bridge_name='br-int',has_traffic_filtering=True,id=6a33d1ba-174c-4dc6-9b82-76c07db2aa28,network=Network(c16b7124-e118-43f9-9cc8-baf4eda9ec31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a33d1ba-17') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5475370-5bb4-5964-b335-b24e2086cfc0', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a33d1ba-17, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a33d1ba-17, col_values=(('qos', UUID('ea0d089d-86d1-491b-a80a-c2ab703c09e7')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a33d1ba-17, col_values=(('external_ids', {'iface-id': '6a33d1ba-174c-4dc6-9b82-76c07db2aa28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:ac:75', 'vm-uuid': 'f308e6dd-371b-466a-88d4-1d186fef55d3'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:39 user nova-compute[75205]: INFO os_vif [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ac:75,bridge_name='br-int',has_traffic_filtering=True,id=6a33d1ba-174c-4dc6-9b82-76c07db2aa28,network=Network(c16b7124-e118-43f9-9cc8-baf4eda9ec31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a33d1ba-17')
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No VIF found with MAC fa:16:3e:8c:ac:75, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-4113dfc8-88f7-4bfc-b5f8-31992712b002 req-5fbef9c2-3321-4569-a92d-720fbfd35204 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updated VIF entry in instance network info cache for port 6a33d1ba-174c-4dc6-9b82-76c07db2aa28. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG nova.network.neutron [req-4113dfc8-88f7-4bfc-b5f8-31992712b002 req-5fbef9c2-3321-4569-a92d-720fbfd35204 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating instance_info_cache with network_info: [{"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:34:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4113dfc8-88f7-4bfc-b5f8-31992712b002 req-5fbef9c2-3321-4569-a92d-720fbfd35204 service nova] Releasing lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:34:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-82b9ec95-184a-4863-9588-8c671c72d60e req-09d48077-d37b-468b-86cd-042765bcebe0 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received event network-vif-plugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:34:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-82b9ec95-184a-4863-9588-8c671c72d60e req-09d48077-d37b-468b-86cd-042765bcebe0 service nova] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-82b9ec95-184a-4863-9588-8c671c72d60e req-09d48077-d37b-468b-86cd-042765bcebe0 service nova] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-82b9ec95-184a-4863-9588-8c671c72d60e req-09d48077-d37b-468b-86cd-042765bcebe0 service nova] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-82b9ec95-184a-4863-9588-8c671c72d60e req-09d48077-d37b-468b-86cd-042765bcebe0 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] No waiting events found dispatching network-vif-plugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:34:41 user nova-compute[75205]: WARNING nova.compute.manager [req-82b9ec95-184a-4863-9588-8c671c72d60e req-09d48077-d37b-468b-86cd-042765bcebe0 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received unexpected event network-vif-plugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 for instance with vm_state building and task_state spawning.
Nov 14 19:34:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:42 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:34:43 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Instance spawned successfully.
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:43 user nova-compute[75205]: INFO nova.compute.manager [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.compute.manager [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-27b561d2-e2e1-411d-b261-2079da6ecbd4 req-63add62e-e4b4-4f37-9190-23e42515d386 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received event network-vif-plugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-27b561d2-e2e1-411d-b261-2079da6ecbd4 req-63add62e-e4b4-4f37-9190-23e42515d386 service nova] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-27b561d2-e2e1-411d-b261-2079da6ecbd4 req-63add62e-e4b4-4f37-9190-23e42515d386 service nova] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-27b561d2-e2e1-411d-b261-2079da6ecbd4 req-63add62e-e4b4-4f37-9190-23e42515d386 service nova] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG nova.compute.manager [req-27b561d2-e2e1-411d-b261-2079da6ecbd4 req-63add62e-e4b4-4f37-9190-23e42515d386 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] No waiting events found dispatching network-vif-plugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:34:43 user nova-compute[75205]: WARNING nova.compute.manager [req-27b561d2-e2e1-411d-b261-2079da6ecbd4 req-63add62e-e4b4-4f37-9190-23e42515d386 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received unexpected event network-vif-plugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 for instance with vm_state building and task_state spawning.
Nov 14 19:34:43 user nova-compute[75205]: INFO nova.compute.manager [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Took 6.24 seconds to build instance.
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3aaf3cfa-8a3a-4303-acac-78a162634258 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.367s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:34:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:34:44 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:34:44 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:34:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=25.11540985107422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance d9701a07-02df-476e-8621-caedcfc72c4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance f308e6dd-371b-466a-88d4-1d186fef55d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:34:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:45 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:45 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:45 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:34:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:34:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-d9701a07-02df-476e-8621-caedcfc72c4e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:34:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-d9701a07-02df-476e-8621-caedcfc72c4e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:34:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:34:48 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid d9701a07-02df-476e-8621-caedcfc72c4e {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:34:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Updating instance_info_cache with network_info: [{"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:34:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-d9701a07-02df-476e-8621-caedcfc72c4e" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:34:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:34:49 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "d9701a07-02df-476e-8621-caedcfc72c4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "d9701a07-02df-476e-8621-caedcfc72c4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:52 user nova-compute[75205]: INFO nova.compute.manager [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Terminating instance
Nov 14 19:34:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:34:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-12124511-099b-46ca-bd41-8ae0775e785e req-80beb047-c98e-474f-878a-c19dfce34a66 service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Received event network-vif-unplugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-12124511-099b-46ca-bd41-8ae0775e785e req-80beb047-c98e-474f-878a-c19dfce34a66 service nova] Acquiring lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-12124511-099b-46ca-bd41-8ae0775e785e req-80beb047-c98e-474f-878a-c19dfce34a66 service nova] Lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-12124511-099b-46ca-bd41-8ae0775e785e req-80beb047-c98e-474f-878a-c19dfce34a66 service nova] Lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-12124511-099b-46ca-bd41-8ae0775e785e req-80beb047-c98e-474f-878a-c19dfce34a66 service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] No waiting events found dispatching network-vif-unplugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-12124511-099b-46ca-bd41-8ae0775e785e req-80beb047-c98e-474f-878a-c19dfce34a66 service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Received event network-vif-unplugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:34:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Instance destroyed successfully.
Nov 14 19:34:53 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lazy-loading 'resources' on Instance uuid d9701a07-02df-476e-8621-caedcfc72c4e {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-169056188',display_name='tempest-VolumesActionsTest-instance-169056188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-169056188',id=44,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68806249c8994e92aa504fe2458bbfa5',ramdisk_id='',reservation_id='r-u37aus9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1905321778',owner_user_name='tempest-VolumesActionsTest-1905321778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:33:08Z,user_data=None,user_id='bc437e677797481d8ab81298fb5404ef',uuid=d9701a07-02df-476e-8621-caedcfc72c4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converting VIF {"id": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "address": "fa:16:3e:e7:fa:c6", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ba5fa49-54", "ovs_interfaceid": "9ba5fa49-540d-4842-a325-4ccf5ba78e52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fa:c6,bridge_name='br-int',has_traffic_filtering=True,id=9ba5fa49-540d-4842-a325-4ccf5ba78e52,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba5fa49-54') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG os_vif [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fa:c6,bridge_name='br-int',has_traffic_filtering=True,id=9ba5fa49-540d-4842-a325-4ccf5ba78e52,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba5fa49-54') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ba5fa49-54, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67b1ea83-030c-4738-838f-9ed694f3eb0a) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:34:53 user nova-compute[75205]: INFO os_vif [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fa:c6,bridge_name='br-int',has_traffic_filtering=True,id=9ba5fa49-540d-4842-a325-4ccf5ba78e52,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ba5fa49-54')
Nov 14 19:34:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Deleting instance files /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e_del
Nov 14 19:34:53 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Deletion of /opt/stack/data/nova/instances/d9701a07-02df-476e-8621-caedcfc72c4e_del complete
Nov 14 19:34:53 user nova-compute[75205]: INFO nova.compute.manager [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 19:34:53 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:34:53 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:34:54 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Took 0.68 seconds to deallocate network for instance.
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] There are 0 instances to clean {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:54 user nova-compute[75205]: WARNING nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Nov 14 19:34:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid d9701a07-02df-476e-8621-caedcfc72c4e {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "d9701a07-02df-476e-8621-caedcfc72c4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:54 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Deleted allocations for instance d9701a07-02df-476e-8621-caedcfc72c4e
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b65adcff-c286-4f10-b7aa-71acd0122aa8 tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "d9701a07-02df-476e-8621-caedcfc72c4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.937s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "d9701a07-02df-476e-8621-caedcfc72c4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.103s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "d9701a07-02df-476e-8621-caedcfc72c4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.021s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-64998515-23ed-4870-bbe0-50f1e47cb5eb req-7b85b851-a333-4a4e-baac-c3d0769237ce service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Received event network-vif-plugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:34:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-64998515-23ed-4870-bbe0-50f1e47cb5eb req-7b85b851-a333-4a4e-baac-c3d0769237ce service nova] Acquiring lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:34:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-64998515-23ed-4870-bbe0-50f1e47cb5eb req-7b85b851-a333-4a4e-baac-c3d0769237ce service nova] Lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:34:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-64998515-23ed-4870-bbe0-50f1e47cb5eb req-7b85b851-a333-4a4e-baac-c3d0769237ce service nova] Lock "d9701a07-02df-476e-8621-caedcfc72c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:34:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-64998515-23ed-4870-bbe0-50f1e47cb5eb req-7b85b851-a333-4a4e-baac-c3d0769237ce service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] No waiting events found dispatching network-vif-plugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:34:55 user nova-compute[75205]: WARNING nova.compute.manager [req-64998515-23ed-4870-bbe0-50f1e47cb5eb req-7b85b851-a333-4a4e-baac-c3d0769237ce service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Received unexpected event network-vif-plugged-9ba5fa49-540d-4842-a325-4ccf5ba78e52 for instance with vm_state deleted and task_state None.
Nov 14 19:34:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-64998515-23ed-4870-bbe0-50f1e47cb5eb req-7b85b851-a333-4a4e-baac-c3d0769237ce service nova] [instance: d9701a07-02df-476e-8621-caedcfc72c4e] Received event network-vif-deleted-9ba5fa49-540d-4842-a325-4ccf5ba78e52 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:34:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75205) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 19:34:56 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:57 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:34:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:34:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:35:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:35:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:35:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:35:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-cc8aa09a-0217-4673-a52a-652923726f0c req-49eeefaf-06e6-43ec-a283-b203a8ec8af8 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received event network-changed-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:35:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-cc8aa09a-0217-4673-a52a-652923726f0c req-49eeefaf-06e6-43ec-a283-b203a8ec8af8 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Refreshing instance network info cache due to event network-changed-fa96cb5c-0ee0-464c-b53c-4a34e62147a2. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:35:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cc8aa09a-0217-4673-a52a-652923726f0c req-49eeefaf-06e6-43ec-a283-b203a8ec8af8 service nova] Acquiring lock "refresh_cache-da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:35:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cc8aa09a-0217-4673-a52a-652923726f0c req-49eeefaf-06e6-43ec-a283-b203a8ec8af8 service nova] Acquired lock "refresh_cache-da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:35:31 user nova-compute[75205]: DEBUG nova.network.neutron [req-cc8aa09a-0217-4673-a52a-652923726f0c req-49eeefaf-06e6-43ec-a283-b203a8ec8af8 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Refreshing network info cache for port fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG nova.objects.instance [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lazy-loading 'flavor' on Instance uuid da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:35:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Ignoring supplied device name: /dev/vdb
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:32 user nova-compute[75205]: INFO nova.compute.manager [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Attaching volume da507cd7-c2f5-4dd3-abda-0c3044f9cb08 to /dev/vdb
Nov 14 19:35:32 user nova-compute[75205]: DEBUG os_brick.utils [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d6ae53-f78b-4d83-9684-d91f8de2b6b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1244d366-8432-47ce-9274-acb34da3a96b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2e4579-4100-4b40-a816-b31bcf29c4fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5176d7c6-ff1a-4461-a760-1e02dbf42322]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:35:32 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd93535d-eaa9-4a8a-8c03-0446afb0ba42]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG os_brick.utils [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Updating existing volume attachment record: b0ed4405-4255-4700-b92e-f06536670eb8 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG nova.network.neutron [req-cc8aa09a-0217-4673-a52a-652923726f0c req-49eeefaf-06e6-43ec-a283-b203a8ec8af8 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Updated VIF entry in instance network info cache for port fa96cb5c-0ee0-464c-b53c-4a34e62147a2. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG nova.network.neutron [req-cc8aa09a-0217-4673-a52a-652923726f0c req-49eeefaf-06e6-43ec-a283-b203a8ec8af8 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Updating instance_info_cache with network_info: [{"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:35:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cc8aa09a-0217-4673-a52a-652923726f0c req-49eeefaf-06e6-43ec-a283-b203a8ec8af8 service nova] Releasing lock "refresh_cache-da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:35:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:35:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:34 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:35:34 user nova-compute[75205]: INFO nova.compute.claims [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Claim successful on node user
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:35:35 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.policy [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58202884478148cc892c360d7a2ee222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a60993cb67d417194f8f9ef73e84550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:35:35 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Creating image(s)
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "/opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "/opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "/opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk 1073741824" returned: 0 in 0.101s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Successfully created port: 745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:35:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Cannot resize image /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Ensure instance console log exists: /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Successfully updated port: 745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquired lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.compute.manager [req-3645e952-aeab-4333-b0aa-4e8e9d6cd56c req-e7fccfea-a228-45b6-96f0-25460811622d service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-changed-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.compute.manager [req-3645e952-aeab-4333-b0aa-4e8e9d6cd56c req-e7fccfea-a228-45b6-96f0-25460811622d service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Refreshing instance network info cache due to event network-changed-745822ef-b300-4571-b0e6-392b770bb96c. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3645e952-aeab-4333-b0aa-4e8e9d6cd56c req-e7fccfea-a228-45b6-96f0-25460811622d service nova] Acquiring lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdbLGJSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:35:36 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:35:36 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:35:36 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a436a1b-a6e9-4272-9555-4834fec38dfb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:35:36 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cf014d-4689-4a8c-8c9b-de20c5a3a89f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08] added
Nov 14 19:35:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a4d3fc-f79c-484f-837a-89ebadd96b0d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7853f21-1aa6-41e4-b43a-a1fe4c0092bd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HdbLGJSW {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HdbLGJSW" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[61210ba8-2423-41bc-a163-6e73d1f0680e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HdbLGJSW'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating instance_info_cache with network_info: [{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Releasing lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance network_info: |[{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7fed27-f1f0-4297-b0e8-f2e532d98bb9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3645e952-aeab-4333-b0aa-4e8e9d6cd56c req-e7fccfea-a228-45b6-96f0-25460811622d service nova] Acquired lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.network.neutron [req-3645e952-aeab-4333-b0aa-4e8e9d6cd56c req-e7fccfea-a228-45b6-96f0-25460811622d service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Refreshing network info cache for port 745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Start _get_guest_xml network_info=[{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d6e114-4de0-44dd-96d4-3bd1780e9d36]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:35:36 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:35:36 user nova-compute[75205]:  {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:35:36 user nova-compute[75205]: WARNING os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 19:35:36 user nova-compute[75205]: 
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:36 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:35:36 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-321592417',display_name='tempest-AttachVolumeTestJSON-server-321592417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-321592417',id=47,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwkYbMF2eFIKA42xW5vusjYSx4d8QgjUMIaP8oZNrds3UxZnMzXAOuFIsJqr7xOLlKmCiZ6+648aTqutgtELdkijulMWKFIOLQwHhmQ7THLE7FldU881gEvk+xJb0lcdg==',key_name='tempest-keypair-594362825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-96r2n4ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=43121bd9-325e-4328-8d35-1448d2dd3d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG nova.objects.instance [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'pci_devices' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc18d43-cffa-4481-a2f2-abb28477f536]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08, portal: 172.16.0.220,3260]
Nov 14 19:35:36 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08, portal: 172.16.0.220,3260] successful.
Nov 14 19:35:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:35:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:35:37 user nova-compute[75205]:   <uuid>43121bd9-325e-4328-8d35-1448d2dd3d23</uuid>
Nov 14 19:35:37 user nova-compute[75205]:   <name>instance-0000002f</name>
Nov 14 19:35:37 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:35:37 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:35:37 user nova-compute[75205]:   <metadata>
Nov 14 19:35:37 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:35:37 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:35:37 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeTestJSON-server-321592417</nova:name>
Nov 14 19:35:37 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:35:36</nova:creationTime>
Nov 14 19:35:37 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:35:37 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:35:37 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:35:37 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:35:37 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:35:37 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:35:37 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:35:37 user nova-compute[75205]:       <nova:owner>
Nov 14 19:35:37 user nova-compute[75205]:         <nova:user uuid="58202884478148cc892c360d7a2ee222">tempest-AttachVolumeTestJSON-282088086-project-member</nova:user>
Nov 14 19:35:37 user nova-compute[75205]:         <nova:project uuid="2a60993cb67d417194f8f9ef73e84550">tempest-AttachVolumeTestJSON-282088086</nova:project>
Nov 14 19:35:37 user nova-compute[75205]:       </nova:owner>
Nov 14 19:35:37 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:35:37 user nova-compute[75205]:       <nova:ports>
Nov 14 19:35:37 user nova-compute[75205]:         <nova:port uuid="745822ef-b300-4571-b0e6-392b770bb96c">
Nov 14 19:35:37 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 19:35:37 user nova-compute[75205]:         </nova:port>
Nov 14 19:35:37 user nova-compute[75205]:       </nova:ports>
Nov 14 19:35:37 user nova-compute[75205]:     </nova:instance>
Nov 14 19:35:37 user nova-compute[75205]:   </metadata>
Nov 14 19:35:37 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:35:37 user nova-compute[75205]:     <system>
Nov 14 19:35:37 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:35:37 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:35:37 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:35:37 user nova-compute[75205]:       <entry name="serial">43121bd9-325e-4328-8d35-1448d2dd3d23</entry>
Nov 14 19:35:37 user nova-compute[75205]:       <entry name="uuid">43121bd9-325e-4328-8d35-1448d2dd3d23</entry>
Nov 14 19:35:37 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:35:37 user nova-compute[75205]:     </system>
Nov 14 19:35:37 user nova-compute[75205]:   </sysinfo>
Nov 14 19:35:37 user nova-compute[75205]:   <os>
Nov 14 19:35:37 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:35:37 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:35:37 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:35:37 user nova-compute[75205]:   </os>
Nov 14 19:35:37 user nova-compute[75205]:   <features>
Nov 14 19:35:37 user nova-compute[75205]:     <acpi/>
Nov 14 19:35:37 user nova-compute[75205]:     <apic/>
Nov 14 19:35:37 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:35:37 user nova-compute[75205]:   </features>
Nov 14 19:35:37 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:35:37 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:35:37 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:35:37 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:35:37 user nova-compute[75205]:   </clock>
Nov 14 19:35:37 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:35:37 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:35:37 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:35:37 user nova-compute[75205]:   </cpu>
Nov 14 19:35:37 user nova-compute[75205]:   <devices>
Nov 14 19:35:37 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:35:37 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:35:37 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk"/>
Nov 14 19:35:37 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:35:37 user nova-compute[75205]:     </disk>
Nov 14 19:35:37 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:35:37 user nova-compute[75205]:       <mac address="fa:16:3e:15:70:50"/>
Nov 14 19:35:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:35:37 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:35:37 user nova-compute[75205]:       <target dev="tap745822ef-b3"/>
Nov 14 19:35:37 user nova-compute[75205]:     </interface>
Nov 14 19:35:37 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:35:37 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/console.log" append="off"/>
Nov 14 19:35:37 user nova-compute[75205]:     </serial>
Nov 14 19:35:37 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:35:37 user nova-compute[75205]:     <video>
Nov 14 19:35:37 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:35:37 user nova-compute[75205]:     </video>
Nov 14 19:35:37 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:35:37 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:35:37 user nova-compute[75205]:     </rng>
Nov 14 19:35:37 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:35:37 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:35:37 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:35:37 user nova-compute[75205]:     </memballoon>
Nov 14 19:35:37 user nova-compute[75205]:   </devices>
Nov 14 19:35:37 user nova-compute[75205]: </domain>
Nov 14 19:35:37 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-321592417',display_name='tempest-AttachVolumeTestJSON-server-321592417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-321592417',id=47,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwkYbMF2eFIKA42xW5vusjYSx4d8QgjUMIaP8oZNrds3UxZnMzXAOuFIsJqr7xOLlKmCiZ6+648aTqutgtELdkijulMWKFIOLQwHhmQ7THLE7FldU881gEvk+xJb0lcdg==',key_name='tempest-keypair-594362825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-96r2n4ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=43121bd9-325e-4328-8d35-1448d2dd3d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG os_vif [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4af0f320-c38b-5109-9c79-5c42dceb2584', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0a39f7-7a26-4fe3-8d0f-e3e10d44b093]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap745822ef-b3, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap745822ef-b3, col_values=(('qos', UUID('216fc1f4-12eb-418f-bd1d-4cb996591fe0')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap745822ef-b3, col_values=(('external_ids', {'iface-id': '745822ef-b300-4571-b0e6-392b770bb96c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:70:50', 'vm-uuid': '43121bd9-325e-4328-8d35-1448d2dd3d23'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:37 user nova-compute[75205]: INFO os_vif [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3')
Nov 14 19:35:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e0f8b8-1871-4575-843a-8d639a33ce52]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 (non-flash)
Nov 14 19:35:37 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 (non-flash)
Nov 14 19:35:37 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1755c1b-fed0-4796-82c8-77ab6e0bf7f9]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdbLGJSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No VIF found with MAC fa:16:3e:15:70:50, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG nova.network.neutron [req-3645e952-aeab-4333-b0aa-4e8e9d6cd56c req-e7fccfea-a228-45b6-96f0-25460811622d service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updated VIF entry in instance network info cache for port 745822ef-b300-4571-b0e6-392b770bb96c. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG nova.network.neutron [req-3645e952-aeab-4333-b0aa-4e8e9d6cd56c req-e7fccfea-a228-45b6-96f0-25460811622d service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating instance_info_cache with network_info: [{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-3645e952-aeab-4333-b0aa-4e8e9d6cd56c req-e7fccfea-a228-45b6-96f0-25460811622d service nova] Releasing lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:35:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26261376134386335', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261376134386335', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG nova.objects.instance [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lazy-loading 'flavor' on Instance uuid da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:35:38 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:35:38 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:35:38 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:35:38 user nova-compute[75205]:   <serial>da507cd7-c2f5-4dd3-abda-0c3044f9cb08</serial>
Nov 14 19:35:38 user nova-compute[75205]: </disk>
Nov 14 19:35:38 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] No VIF found with MAC fa:16:3e:10:3a:b5, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a94c55c5-4d9e-46b7-b311-c5d7e44979a8 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.605s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG nova.compute.manager [req-43de63e8-dc9b-4e6f-aa65-df13a4cf1659 req-8fa6c3b0-7732-4719-9d81-6e09c8f38197 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-43de63e8-dc9b-4e6f-aa65-df13a4cf1659 req-8fa6c3b0-7732-4719-9d81-6e09c8f38197 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-43de63e8-dc9b-4e6f-aa65-df13a4cf1659 req-8fa6c3b0-7732-4719-9d81-6e09c8f38197 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-43de63e8-dc9b-4e6f-aa65-df13a4cf1659 req-8fa6c3b0-7732-4719-9d81-6e09c8f38197 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:38 user nova-compute[75205]: DEBUG nova.compute.manager [req-43de63e8-dc9b-4e6f-aa65-df13a4cf1659 req-8fa6c3b0-7732-4719-9d81-6e09c8f38197 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:35:38 user nova-compute[75205]: WARNING nova.compute.manager [req-43de63e8-dc9b-4e6f-aa65-df13a4cf1659 req-8fa6c3b0-7732-4719-9d81-6e09c8f38197 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state building and task_state spawning.
Nov 14 19:35:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:35:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:35:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance spawned successfully.
Nov 14 19:35:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:35:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:40 user nova-compute[75205]: INFO nova.compute.manager [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 14 19:35:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:35:40 user nova-compute[75205]: INFO nova.compute.manager [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Took 6.16 seconds to build instance.
Nov 14 19:35:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a4cee1cc-5cbc-4f08-85d6-5151687ceeb6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.258s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-186d63a8-7d44-463a-b7f3-78552737ada0 req-ab2c8084-ee9d-4b00-994a-3596945fb4e8 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:35:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-186d63a8-7d44-463a-b7f3-78552737ada0 req-ab2c8084-ee9d-4b00-994a-3596945fb4e8 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-186d63a8-7d44-463a-b7f3-78552737ada0 req-ab2c8084-ee9d-4b00-994a-3596945fb4e8 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-186d63a8-7d44-463a-b7f3-78552737ada0 req-ab2c8084-ee9d-4b00-994a-3596945fb4e8 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-186d63a8-7d44-463a-b7f3-78552737ada0 req-ab2c8084-ee9d-4b00-994a-3596945fb4e8 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:35:41 user nova-compute[75205]: WARNING nova.compute.manager [req-186d63a8-7d44-463a-b7f3-78552737ada0 req-ab2c8084-ee9d-4b00-994a-3596945fb4e8 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state active and task_state None.
Nov 14 19:35:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:43 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:35:43 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:35:44 user nova-compute[75205]: INFO nova.compute.claims [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Claim successful on node user
Nov 14 19:35:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Refreshing inventories for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Updating ProviderTree inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Refreshing aggregate associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, aggregates: None {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Refreshing trait associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, traits: HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.438s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:35:44 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:35:44 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:35:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG nova.policy [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc437e677797481d8ab81298fb5404ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68806249c8994e92aa504fe2458bbfa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:35:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Creating image(s)
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "/opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "/opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.203s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Successfully created port: bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk 1073741824" returned: 0 in 0.047s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.202s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:35:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Cannot resize image /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Ensure instance console log exists: /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Successfully updated port: bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "refresh_cache-f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquired lock "refresh_cache-f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-55272244-f315-4061-9140-130f53690a26 req-613117ab-b332-4d7a-a8ac-34b805393615 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Received event network-changed-bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.compute.manager [req-55272244-f315-4061-9140-130f53690a26 req-613117ab-b332-4d7a-a8ac-34b805393615 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Refreshing instance network info cache due to event network-changed-bd98b875-f312-465f-945f-ab4b1e6244da. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-55272244-f315-4061-9140-130f53690a26 req-613117ab-b332-4d7a-a8ac-34b805393615 service nova] Acquiring lock "refresh_cache-f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:35:46 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:35:46 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8632MB free_disk=25.102645874023438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance f308e6dd-371b-466a-88d4-1d186fef55d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:35:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.network.neutron [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Updating instance_info_cache with network_info: [{"id": "bd98b875-f312-465f-945f-ab4b1e6244da", "address": "fa:16:3e:d4:0c:27", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd98b875-f3", "ovs_interfaceid": "bd98b875-f312-465f-945f-ab4b1e6244da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:47 user nova-compute[75205]: INFO nova.compute.manager [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Detaching volume da507cd7-c2f5-4dd3-abda-0c3044f9cb08
Nov 14 19:35:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Releasing lock "refresh_cache-f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Instance network_info: |[{"id": "bd98b875-f312-465f-945f-ab4b1e6244da", "address": "fa:16:3e:d4:0c:27", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd98b875-f3", "ovs_interfaceid": "bd98b875-f312-465f-945f-ab4b1e6244da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-55272244-f315-4061-9140-130f53690a26 req-613117ab-b332-4d7a-a8ac-34b805393615 service nova] Acquired lock "refresh_cache-f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.network.neutron [req-55272244-f315-4061-9140-130f53690a26 req-613117ab-b332-4d7a-a8ac-34b805393615 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Refreshing network info cache for port bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Start _get_guest_xml network_info=[{"id": "bd98b875-f312-465f-945f-ab4b1e6244da", "address": "fa:16:3e:d4:0c:27", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd98b875-f3", "ovs_interfaceid": "bd98b875-f312-465f-945f-ab4b1e6244da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:35:47 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:35:47 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-66507387',display_name='tempest-VolumesActionsTest-instance-66507387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-66507387',id=48,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68806249c8994e92aa504fe2458bbfa5',ramdisk_id='',reservation_id='r-7fwx0gu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1905321778',owner_user_name='tempest-VolumesActionsTest-1905321778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:35:45Z,user_data=None,user_id='bc437e677797481d8ab81298fb5404ef',uuid=f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd98b875-f312-465f-945f-ab4b1e6244da", "address": "fa:16:3e:d4:0c:27", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd98b875-f3", "ovs_interfaceid": "bd98b875-f312-465f-945f-ab4b1e6244da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converting VIF {"id": "bd98b875-f312-465f-945f-ab4b1e6244da", "address": "fa:16:3e:d4:0c:27", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd98b875-f3", "ovs_interfaceid": "bd98b875-f312-465f-945f-ab4b1e6244da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0c:27,bridge_name='br-int',has_traffic_filtering=True,id=bd98b875-f312-465f-945f-ab4b1e6244da,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd98b875-f3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lazy-loading 'pci_devices' on Instance uuid f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:35:47 user nova-compute[75205]: INFO nova.virt.block_device [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Attempting to driver detach volume da507cd7-c2f5-4dd3-abda-0c3044f9cb08 from mountpoint /dev/vdb
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:35:47 user nova-compute[75205]:   <uuid>f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a</uuid>
Nov 14 19:35:47 user nova-compute[75205]:   <name>instance-00000030</name>
Nov 14 19:35:47 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:35:47 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:35:47 user nova-compute[75205]:   <metadata>
Nov 14 19:35:47 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:35:47 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:35:47 user nova-compute[75205]:       <nova:name>tempest-VolumesActionsTest-instance-66507387</nova:name>
Nov 14 19:35:47 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:35:47</nova:creationTime>
Nov 14 19:35:47 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:35:47 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:35:47 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:35:47 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:35:47 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:35:47 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:35:47 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:35:47 user nova-compute[75205]:       <nova:owner>
Nov 14 19:35:47 user nova-compute[75205]:         <nova:user uuid="bc437e677797481d8ab81298fb5404ef">tempest-VolumesActionsTest-1905321778-project-member</nova:user>
Nov 14 19:35:47 user nova-compute[75205]:         <nova:project uuid="68806249c8994e92aa504fe2458bbfa5">tempest-VolumesActionsTest-1905321778</nova:project>
Nov 14 19:35:47 user nova-compute[75205]:       </nova:owner>
Nov 14 19:35:47 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:35:47 user nova-compute[75205]:       <nova:ports>
Nov 14 19:35:47 user nova-compute[75205]:         <nova:port uuid="bd98b875-f312-465f-945f-ab4b1e6244da">
Nov 14 19:35:47 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 19:35:47 user nova-compute[75205]:         </nova:port>
Nov 14 19:35:47 user nova-compute[75205]:       </nova:ports>
Nov 14 19:35:47 user nova-compute[75205]:     </nova:instance>
Nov 14 19:35:47 user nova-compute[75205]:   </metadata>
Nov 14 19:35:47 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:35:47 user nova-compute[75205]:     <system>
Nov 14 19:35:47 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:35:47 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:35:47 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:35:47 user nova-compute[75205]:       <entry name="serial">f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a</entry>
Nov 14 19:35:47 user nova-compute[75205]:       <entry name="uuid">f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a</entry>
Nov 14 19:35:47 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:35:47 user nova-compute[75205]:     </system>
Nov 14 19:35:47 user nova-compute[75205]:   </sysinfo>
Nov 14 19:35:47 user nova-compute[75205]:   <os>
Nov 14 19:35:47 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:35:47 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:35:47 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:35:47 user nova-compute[75205]:   </os>
Nov 14 19:35:47 user nova-compute[75205]:   <features>
Nov 14 19:35:47 user nova-compute[75205]:     <acpi/>
Nov 14 19:35:47 user nova-compute[75205]:     <apic/>
Nov 14 19:35:47 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:35:47 user nova-compute[75205]:   </features>
Nov 14 19:35:47 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:35:47 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:35:47 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:35:47 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:35:47 user nova-compute[75205]:   </clock>
Nov 14 19:35:47 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:35:47 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:35:47 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:35:47 user nova-compute[75205]:   </cpu>
Nov 14 19:35:47 user nova-compute[75205]:   <devices>
Nov 14 19:35:47 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:35:47 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:35:47 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk"/>
Nov 14 19:35:47 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:35:47 user nova-compute[75205]:     </disk>
Nov 14 19:35:47 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:35:47 user nova-compute[75205]:       <mac address="fa:16:3e:d4:0c:27"/>
Nov 14 19:35:47 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:35:47 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:35:47 user nova-compute[75205]:       <target dev="tapbd98b875-f3"/>
Nov 14 19:35:47 user nova-compute[75205]:     </interface>
Nov 14 19:35:47 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:35:47 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/console.log" append="off"/>
Nov 14 19:35:47 user nova-compute[75205]:     </serial>
Nov 14 19:35:47 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:35:47 user nova-compute[75205]:     <video>
Nov 14 19:35:47 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:35:47 user nova-compute[75205]:     </video>
Nov 14 19:35:47 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:35:47 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:35:47 user nova-compute[75205]:     </rng>
Nov 14 19:35:47 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:35:47 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:35:47 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:35:47 user nova-compute[75205]:     </memballoon>
Nov 14 19:35:47 user nova-compute[75205]:   </devices>
Nov 14 19:35:47 user nova-compute[75205]: </domain>
Nov 14 19:35:47 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-66507387',display_name='tempest-VolumesActionsTest-instance-66507387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-66507387',id=48,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68806249c8994e92aa504fe2458bbfa5',ramdisk_id='',reservation_id='r-7fwx0gu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1905321778',owner_user_name='tempest-VolumesActionsTest-1905321778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:35:45Z,user_data=None,user_id='bc437e677797481d8ab81298fb5404ef',uuid=f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd98b875-f312-465f-945f-ab4b1e6244da", "address": "fa:16:3e:d4:0c:27", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd98b875-f3", "ovs_interfaceid": "bd98b875-f312-465f-945f-ab4b1e6244da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converting VIF {"id": "bd98b875-f312-465f-945f-ab4b1e6244da", "address": "fa:16:3e:d4:0c:27", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd98b875-f3", "ovs_interfaceid": "bd98b875-f312-465f-945f-ab4b1e6244da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0c:27,bridge_name='br-int',has_traffic_filtering=True,id=bd98b875-f312-465f-945f-ab4b1e6244da,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd98b875-f3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG os_vif [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0c:27,bridge_name='br-int',has_traffic_filtering=True,id=bd98b875-f312-465f-945f-ab4b1e6244da,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd98b875-f3') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cf80d55-b7ad-5340-b0b9-807a8fe4416e', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd98b875-f3, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd98b875-f3, col_values=(('qos', UUID('82d5d119-8230-483d-8b3c-bfc49600a1d2')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd98b875-f3, col_values=(('external_ids', {'iface-id': 'bd98b875-f312-465f-945f-ab4b1e6244da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:0c:27', 'vm-uuid': 'f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Attempting to detach device vdb from instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:35:47 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:35:47 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:35:47 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:35:47 user nova-compute[75205]:   <serial>da507cd7-c2f5-4dd3-abda-0c3044f9cb08</serial>
Nov 14 19:35:47 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:35:47 user nova-compute[75205]: </disk>
Nov 14 19:35:47 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:47 user nova-compute[75205]: INFO os_vif [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0c:27,bridge_name='br-int',has_traffic_filtering=True,id=bd98b875-f312-465f-945f-ab4b1e6244da,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd98b875-f3')
Nov 14 19:35:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Successfully detached device vdb from instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 from the persistent domain config.
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:35:47 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:35:47 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:35:47 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:35:47 user nova-compute[75205]:   <serial>da507cd7-c2f5-4dd3-abda-0c3044f9cb08</serial>
Nov 14 19:35:47 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:35:47 user nova-compute[75205]: </disk>
Nov 14 19:35:47 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] No VIF found with MAC fa:16:3e:d4:0c:27, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.network.neutron [req-55272244-f315-4061-9140-130f53690a26 req-613117ab-b332-4d7a-a8ac-34b805393615 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Updated VIF entry in instance network info cache for port bd98b875-f312-465f-945f-ab4b1e6244da. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.network.neutron [req-55272244-f315-4061-9140-130f53690a26 req-613117ab-b332-4d7a-a8ac-34b805393615 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Updating instance_info_cache with network_info: [{"id": "bd98b875-f312-465f-945f-ab4b1e6244da", "address": "fa:16:3e:d4:0c:27", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd98b875-f3", "ovs_interfaceid": "bd98b875-f312-465f-945f-ab4b1e6244da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-55272244-f315-4061-9140-130f53690a26 req-613117ab-b332-4d7a-a8ac-34b805393615 service nova] Releasing lock "refresh_cache-f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:35:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Skipping network cache update for instance because it is being deleted. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating instance_info_cache with network_info: [{"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:35:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:35:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:35:49 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:35:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-7573be0d-b478-496f-90cc-7bcb3e53b71a req-005d851d-d66c-42bf-b12d-61ee902de782 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Received event network-vif-plugged-bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:35:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7573be0d-b478-496f-90cc-7bcb3e53b71a req-005d851d-d66c-42bf-b12d-61ee902de782 service nova] Acquiring lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7573be0d-b478-496f-90cc-7bcb3e53b71a req-005d851d-d66c-42bf-b12d-61ee902de782 service nova] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7573be0d-b478-496f-90cc-7bcb3e53b71a req-005d851d-d66c-42bf-b12d-61ee902de782 service nova] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-7573be0d-b478-496f-90cc-7bcb3e53b71a req-005d851d-d66c-42bf-b12d-61ee902de782 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] No waiting events found dispatching network-vif-plugged-bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:35:49 user nova-compute[75205]: WARNING nova.compute.manager [req-7573be0d-b478-496f-90cc-7bcb3e53b71a req-005d851d-d66c-42bf-b12d-61ee902de782 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Received unexpected event network-vif-plugged-bd98b875-f312-465f-945f-ab4b1e6244da for instance with vm_state building and task_state spawning.
Nov 14 19:35:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:49 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:35:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:35:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:35:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Instance spawned successfully.
Nov 14 19:35:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:35:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:35:50 user nova-compute[75205]: INFO nova.compute.manager [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 14 19:35:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:35:51 user nova-compute[75205]: INFO nova.compute.manager [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Took 6.68 seconds to build instance.
Nov 14 19:35:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7cb2e276-78e2-4eca-8631-41e874e5e51d tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.778s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-07d91c36-fd63-4a52-8489-d2e04d932cab req-9973c8ce-754b-4d95-8976-e85b0db6d019 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Received event network-vif-plugged-bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:35:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-07d91c36-fd63-4a52-8489-d2e04d932cab req-9973c8ce-754b-4d95-8976-e85b0db6d019 service nova] Acquiring lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:35:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-07d91c36-fd63-4a52-8489-d2e04d932cab req-9973c8ce-754b-4d95-8976-e85b0db6d019 service nova] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:35:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-07d91c36-fd63-4a52-8489-d2e04d932cab req-9973c8ce-754b-4d95-8976-e85b0db6d019 service nova] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:35:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-07d91c36-fd63-4a52-8489-d2e04d932cab req-9973c8ce-754b-4d95-8976-e85b0db6d019 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] No waiting events found dispatching network-vif-plugged-bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:35:51 user nova-compute[75205]: WARNING nova.compute.manager [req-07d91c36-fd63-4a52-8489-d2e04d932cab req-9973c8ce-754b-4d95-8976-e85b0db6d019 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Received unexpected event network-vif-plugged-bd98b875-f312-465f-945f-ab4b1e6244da for instance with vm_state active and task_state None.
Nov 14 19:35:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:52 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:35:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:35:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:07 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 is timed out.
Nov 14 19:36:07 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Successfully detached device vdb from instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 from the live domain config.
Nov 14 19:36:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdbLGJSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:36:07 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bffbd4-be6e-4b36-ac56-e365740a88f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:36:07 user nova-compute[75205]: No targets found.
Nov 14 19:36:07 user nova-compute[75205]: iSNS:
Nov 14 19:36:07 user nova-compute[75205]: No targets found.
Nov 14 19:36:07 user nova-compute[75205]: STATIC:
Nov 14 19:36:07 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08
Nov 14 19:36:07 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:36:07 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:36:07 user nova-compute[75205]: FIRMWARE:
Nov 14 19:36:07 user nova-compute[75205]: No targets found.
Nov 14 19:36:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:36:07 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:36:07 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c119c3-99fe-409d-b05c-724e08427318]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf125d73-5371-4ffd-9f83-f01dbd3deeaa]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 (non-flash)
Nov 14 19:36:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 (non-flash)
Nov 14 19:36:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb54746440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[788631ef-f8ce-4038-afda-8e76ca05269d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2bb212-5c01-4f47-9c65-fd7667049235]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[44acd9cf-e3f7-4a06-83ff-25f9e64fc64d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:36:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c27c38-fa10-481a-87dd-5281f4700f0b]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.120s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5d66ce-6699-4f4d-8688-75541714e7b6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f079d7a-b4a5-4b03-8a41-5bbddcbca69f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08, portal: 172.16.0.220,3260]
Nov 14 19:36:08 user nova-compute[75205]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08, portal: 172.16.0.220,3260] successful.
Nov 14 19:36:08 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e97589b-c552-4c15-88ed-679dd2d5835e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] <== disconnect_volume: return (357ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:36:08 user nova-compute[75205]: DEBUG nova.objects.instance [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lazy-loading 'flavor' on Instance uuid da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-deb5655d-9d5c-4748-affd-8026276543ce tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.956s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.836s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:09 user nova-compute[75205]: INFO nova.compute.manager [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Terminating instance
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-646beeae-a9e6-4f84-a573-eda1acc577fa req-e7661e7f-4455-4a3a-85e1-5451921bdd18 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received event network-vif-unplugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-646beeae-a9e6-4f84-a573-eda1acc577fa req-e7661e7f-4455-4a3a-85e1-5451921bdd18 service nova] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-646beeae-a9e6-4f84-a573-eda1acc577fa req-e7661e7f-4455-4a3a-85e1-5451921bdd18 service nova] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-646beeae-a9e6-4f84-a573-eda1acc577fa req-e7661e7f-4455-4a3a-85e1-5451921bdd18 service nova] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-646beeae-a9e6-4f84-a573-eda1acc577fa req-e7661e7f-4455-4a3a-85e1-5451921bdd18 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] No waiting events found dispatching network-vif-unplugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-646beeae-a9e6-4f84-a573-eda1acc577fa req-e7661e7f-4455-4a3a-85e1-5451921bdd18 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received event network-vif-unplugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:36:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Instance destroyed successfully.
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lazy-loading 'resources' on Instance uuid da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-371088609',display_name='tempest-VolumesSnapshotTestJSON-instance-371088609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-371088609',id=45,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXAinOIECWzW3RvjLJON32ZyxaTyX7dqfRhYHm88qnv0SsDjG0Nk+Ra5p1oZqIihJbTw77MyuDDsY8glAyPlaQYmtYDngQG7aWBnoAqPzgpKJiQNfb3LjTHSB7nadVDXw==',key_name='tempest-keypair-369455307',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6e76b8a1d6f4df4ad01e87a8bcf1e5d',ramdisk_id='',reservation_id='r-l0uxx180',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-880704583',owner_user_name='tempest-VolumesSnapshotTestJSON-880704583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73896b6e82ec4503b7ade30ad9174619',uuid=da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converting VIF {"id": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "address": "fa:16:3e:10:3a:b5", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa96cb5c-0e", "ovs_interfaceid": "fa96cb5c-0ee0-464c-b53c-4a34e62147a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:3a:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa96cb5c-0ee0-464c-b53c-4a34e62147a2,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa96cb5c-0e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG os_vif [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:3a:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa96cb5c-0ee0-464c-b53c-4a34e62147a2,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa96cb5c-0e') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa96cb5c-0e, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81fe56f3-0399-4ec5-8833-03b0931f7bf9) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:09 user nova-compute[75205]: INFO os_vif [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:3a:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa96cb5c-0ee0-464c-b53c-4a34e62147a2,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa96cb5c-0e')
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:da507cd7-c2f5-4dd3-abda-0c3044f9cb08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdbLGJSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:36:09 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:36:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[53c07090-1232-4907-b00f-aa97adbd127d]: Unexpected error while running command.
Nov 14 19:36:09 user nova-compute[75205]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 19:36:09 user nova-compute[75205]: Exit code: 21
Nov 14 19:36:09 user nova-compute[75205]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 19:36:09 user nova-compute[75205]: Stderr: '' {{(pid=85714) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 14 19:36:09 user nova-compute[75205]: Traceback (most recent call last):
Nov 14 19:36:09 user nova-compute[75205]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 14 19:36:09 user nova-compute[75205]:     ret = func(*f_args, **f_kwargs)
Nov 14 19:36:09 user nova-compute[75205]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 14 19:36:09 user nova-compute[75205]:     return func(*args, **kwargs)
Nov 14 19:36:09 user nova-compute[75205]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 14 19:36:09 user nova-compute[75205]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 14 19:36:09 user nova-compute[75205]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 14 19:36:09 user nova-compute[75205]:     return putils.execute(on_execute=on_execute,
Nov 14 19:36:09 user nova-compute[75205]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 14 19:36:09 user nova-compute[75205]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 14 19:36:09 user nova-compute[75205]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 19:36:09 user nova-compute[75205]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 19:36:09 user nova-compute[75205]: Exit code: 21
Nov 14 19:36:09 user nova-compute[75205]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 19:36:09 user nova-compute[75205]: Stderr: ''
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c07090-1232-4907-b00f-aa97adbd127d]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 19:36:09 user nova-compute[75205]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 19:36:09 user nova-compute[75205]: Exit code: 21
Nov 14 19:36:09 user nova-compute[75205]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 19:36:09 user nova-compute[75205]: Stderr: ''
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 14 19:36:09 user nova-compute[75205]: ERROR os_brick.initiator.connectors.iscsi 
Nov 14 19:36:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75205) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.030s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] <== disconnect_volume: return (31ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:36:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Deleting instance files /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9_del
Nov 14 19:36:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Deletion of /opt/stack/data/nova/instances/da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9_del complete
Nov 14 19:36:09 user nova-compute[75205]: INFO nova.compute.manager [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 19:36:09 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:36:09 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:36:10 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:36:10 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Took 0.67 seconds to deallocate network for instance.
Nov 14 19:36:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-3059ce23-ceac-4afa-9f20-6cbab746a3a1 req-6f97c85c-7d76-4729-97be-75bde3c32831 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received event network-vif-deleted-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:36:10 user nova-compute[75205]: INFO nova.compute.manager [req-3059ce23-ceac-4afa-9f20-6cbab746a3a1 req-6f97c85c-7d76-4729-97be-75bde3c32831 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Neutron deleted interface fa96cb5c-0ee0-464c-b53c-4a34e62147a2; detaching it from the instance and deleting it from the info cache
Nov 14 19:36:10 user nova-compute[75205]: DEBUG nova.network.neutron [req-3059ce23-ceac-4afa-9f20-6cbab746a3a1 req-6f97c85c-7d76-4729-97be-75bde3c32831 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:36:10 user nova-compute[75205]: WARNING nova.volume.cinder [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Attachment b0ed4405-4255-4700-b92e-f06536670eb8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b0ed4405-4255-4700-b92e-f06536670eb8. (HTTP 404) (Request-ID: req-d8dd93d1-a453-4c14-9084-2932b590c47e)
Nov 14 19:36:10 user nova-compute[75205]: INFO nova.compute.manager [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 19:36:10 user nova-compute[75205]: DEBUG nova.compute.manager [req-3059ce23-ceac-4afa-9f20-6cbab746a3a1 req-6f97c85c-7d76-4729-97be-75bde3c32831 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Detach interface failed, port_id=fa96cb5c-0ee0-464c-b53c-4a34e62147a2, reason: Instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:36:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:10 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:36:10 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:36:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:10 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Deleted allocations for instance da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9
Nov 14 19:36:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4bfd5753-c091-4bb3-af0d-b623e84f3bc6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.907s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-18e1d7e1-ed16-4a6e-b8cb-a7a78481ec05 req-c11e819c-dee4-4b9c-8cfe-8d0bdf8323f0 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received event network-vif-plugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:36:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-18e1d7e1-ed16-4a6e-b8cb-a7a78481ec05 req-c11e819c-dee4-4b9c-8cfe-8d0bdf8323f0 service nova] Acquiring lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-18e1d7e1-ed16-4a6e-b8cb-a7a78481ec05 req-c11e819c-dee4-4b9c-8cfe-8d0bdf8323f0 service nova] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-18e1d7e1-ed16-4a6e-b8cb-a7a78481ec05 req-c11e819c-dee4-4b9c-8cfe-8d0bdf8323f0 service nova] Lock "da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-18e1d7e1-ed16-4a6e-b8cb-a7a78481ec05 req-c11e819c-dee4-4b9c-8cfe-8d0bdf8323f0 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] No waiting events found dispatching network-vif-plugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:36:11 user nova-compute[75205]: WARNING nova.compute.manager [req-18e1d7e1-ed16-4a6e-b8cb-a7a78481ec05 req-c11e819c-dee4-4b9c-8cfe-8d0bdf8323f0 service nova] [instance: da9ffb6e-9ab2-4da2-b25c-2fca5b24d9e9] Received unexpected event network-vif-plugged-fa96cb5c-0ee0-464c-b53c-4a34e62147a2 for instance with vm_state deleted and task_state None.
Nov 14 19:36:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-7d5521ae-1e72-415a-940f-b84ed1cda2a8 req-43b7e1dc-2b33-4564-97f4-51bcc45d26e0 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received event network-changed-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:36:27 user nova-compute[75205]: DEBUG nova.compute.manager [req-7d5521ae-1e72-415a-940f-b84ed1cda2a8 req-43b7e1dc-2b33-4564-97f4-51bcc45d26e0 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Refreshing instance network info cache due to event network-changed-6a33d1ba-174c-4dc6-9b82-76c07db2aa28. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:36:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7d5521ae-1e72-415a-940f-b84ed1cda2a8 req-43b7e1dc-2b33-4564-97f4-51bcc45d26e0 service nova] Acquiring lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:36:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7d5521ae-1e72-415a-940f-b84ed1cda2a8 req-43b7e1dc-2b33-4564-97f4-51bcc45d26e0 service nova] Acquired lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:36:27 user nova-compute[75205]: DEBUG nova.network.neutron [req-7d5521ae-1e72-415a-940f-b84ed1cda2a8 req-43b7e1dc-2b33-4564-97f4-51bcc45d26e0 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Refreshing network info cache for port 6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:36:28 user nova-compute[75205]: DEBUG nova.network.neutron [req-7d5521ae-1e72-415a-940f-b84ed1cda2a8 req-43b7e1dc-2b33-4564-97f4-51bcc45d26e0 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updated VIF entry in instance network info cache for port 6a33d1ba-174c-4dc6-9b82-76c07db2aa28. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:36:28 user nova-compute[75205]: DEBUG nova.network.neutron [req-7d5521ae-1e72-415a-940f-b84ed1cda2a8 req-43b7e1dc-2b33-4564-97f4-51bcc45d26e0 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating instance_info_cache with network_info: [{"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:36:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7d5521ae-1e72-415a-940f-b84ed1cda2a8 req-43b7e1dc-2b33-4564-97f4-51bcc45d26e0 service nova] Releasing lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:36:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:30 user nova-compute[75205]: INFO nova.compute.manager [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attaching volume 10111d7b-836b-44ba-a72a-78159d49084d to /dev/vdb
Nov 14 19:36:30 user nova-compute[75205]: DEBUG os_brick.utils [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4a49bd-46fc-451a-96ce-c930e128a8cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ea3d14-722e-45fb-98e8-e0554b706e7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9bc524-7d71-4bbc-9b59-e6b79fdcaf7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8d546f-d358-4ca9-91c2-e7b685fbb971]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:36:30 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:36:30 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[05948ad9-caac-4048-9c1f-4992ecf811d4]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG os_brick.utils [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:36:30 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating existing volume attachment record: 8a52b4f8-2ef3-4420-94ce-eddec94f4333 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:36:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUROnJEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:36:35 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:36:35 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:36:35 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee47840-031a-43cc-b210-b8036dd7d279]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:36:35 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c821c5-7e23-47cb-b1f7-2ce71bb28725]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d] added
Nov 14 19:36:35 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03f05f7-458b-46db-abc3-6a69a82c99d2]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdf21b1-cf02-4f86-a1c2-a5fd646a95c4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUROnJEj {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUROnJEj" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[89756cac-62c5-4e47-a789-8674e58d4cb1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUROnJEj'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc67dbc-be84-4477-8066-77fcb3e1e420]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcfce75-2242-4fe0-b18a-949958225c2a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:36:35 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:36:35 user nova-compute[75205]:  {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:36:35 user nova-compute[75205]: WARNING os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 19:36:35 user nova-compute[75205]: 
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c985d0b-20ed-406e-aa04-8b7a99d2313f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d, portal: 172.16.0.220,3260]
Nov 14 19:36:35 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d, portal: 172.16.0.220,3260] successful.
Nov 14 19:36:35 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b5c3de-34e5-47ba-a373-15159485419a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d698f209-683b-416c-9ce7-8f60edf9859f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d (non-flash)
Nov 14 19:36:35 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d (non-flash)
Nov 14 19:36:35 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0258b2cb-6486-4a3c-942d-f48348ec94f2]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:36:35 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUROnJEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:36:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:36:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23566323832633661', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:36:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566323832633661', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:36:36 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:36:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:36:36 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:36:36 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:36:36 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:36:36 user nova-compute[75205]:   <serial>10111d7b-836b-44ba-a72a-78159d49084d</serial>
Nov 14 19:36:36 user nova-compute[75205]: </disk>
Nov 14 19:36:36 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:36:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:36:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:36:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No VIF found with MAC fa:16:3e:8c:ac:75, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:36:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5675b09a-e118-49df-81f5-8bd0dbda206a tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.432s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:43 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:36:43 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:44 user nova-compute[75205]: INFO nova.compute.manager [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Detaching volume 10111d7b-836b-44ba-a72a-78159d49084d
Nov 14 19:36:44 user nova-compute[75205]: INFO nova.virt.block_device [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attempting to driver detach volume 10111d7b-836b-44ba-a72a-78159d49084d from mountpoint /dev/vdb
Nov 14 19:36:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Attempting to detach device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:36:44 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:36:44 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:36:44 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:36:44 user nova-compute[75205]:   <serial>10111d7b-836b-44ba-a72a-78159d49084d</serial>
Nov 14 19:36:44 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:36:44 user nova-compute[75205]: </disk>
Nov 14 19:36:44 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:36:44 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Successfully detached device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the persistent domain config.
Nov 14 19:36:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:36:44 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:36:44 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:36:44 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:36:44 user nova-compute[75205]:   <serial>10111d7b-836b-44ba-a72a-78159d49084d</serial>
Nov 14 19:36:44 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:36:44 user nova-compute[75205]: </disk>
Nov 14 19:36:44 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:46 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:36:46 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8589MB free_disk=25.07207489013672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance f308e6dd-371b-466a-88d4-1d186fef55d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:46 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:36:46 user nova-compute[75205]: INFO nova.compute.claims [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Claim successful on node user
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:36:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.policy [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73896b6e82ec4503b7ade30ad9174619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76b8a1d6f4df4ad01e87a8bcf1e5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:36:47 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Creating image(s)
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "/opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "/opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk 1073741824" returned: 0 in 0.046s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Successfully created port: dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:36:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Cannot resize image /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Ensure instance console log exists: /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Successfully updated port: dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "refresh_cache-a9fcadc7-b19f-43c9-8934-5ef69396348d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquired lock "refresh_cache-a9fcadc7-b19f-43c9-8934-5ef69396348d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-959a2541-a0ba-4b4c-bb66-45ccf62f8646 req-8b13b586-98f8-4bb9-a9f8-b0367b3aa79e service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-changed-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.compute.manager [req-959a2541-a0ba-4b4c-bb66-45ccf62f8646 req-8b13b586-98f8-4bb9-a9f8-b0367b3aa79e service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Refreshing instance network info cache due to event network-changed-dafe4984-eec2-43d2-b2f0-9ec6cf50a316. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-959a2541-a0ba-4b4c-bb66-45ccf62f8646 req-8b13b586-98f8-4bb9-a9f8-b0367b3aa79e service nova] Acquiring lock "refresh_cache-a9fcadc7-b19f-43c9-8934-5ef69396348d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Skipping network cache update for instance because it is Building. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Updating instance_info_cache with network_info: [{"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Releasing lock "refresh_cache-a9fcadc7-b19f-43c9-8934-5ef69396348d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Instance network_info: |[{"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-959a2541-a0ba-4b4c-bb66-45ccf62f8646 req-8b13b586-98f8-4bb9-a9f8-b0367b3aa79e service nova] Acquired lock "refresh_cache-a9fcadc7-b19f-43c9-8934-5ef69396348d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.neutron [req-959a2541-a0ba-4b4c-bb66-45ccf62f8646 req-8b13b586-98f8-4bb9-a9f8-b0367b3aa79e service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Refreshing network info cache for port dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Start _get_guest_xml network_info=[{"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:36:48 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:36:48 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-461364657',display_name='tempest-VolumesSnapshotTestJSON-instance-461364657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-461364657',id=49,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1NniT8VCfqzSNutnIgpKWQPKx/351L01wN8n0a0kyExjFjMrBOCbhIuX7qKlYUs7dB2CDdz72W92sHIO+1eS8df9G79hNJ/NLe7O07kRpDTF3gshBiaR1t+N6/UXXKDQ==',key_name='tempest-keypair-1485353283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6e76b8a1d6f4df4ad01e87a8bcf1e5d',ramdisk_id='',reservation_id='r-d0sdl3uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-880704583',owner_user_name='tempest-VolumesSnapshotTestJSON-880704583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73896b6e82ec4503b7ade30ad9174619',uuid=a9fcadc7-b19f-43c9-8934-5ef69396348d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converting VIF {"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9c:db,bridge_name='br-int',has_traffic_filtering=True,id=dafe4984-eec2-43d2-b2f0-9ec6cf50a316,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdafe4984-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.objects.instance [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lazy-loading 'pci_devices' on Instance uuid a9fcadc7-b19f-43c9-8934-5ef69396348d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:36:48 user nova-compute[75205]:   <uuid>a9fcadc7-b19f-43c9-8934-5ef69396348d</uuid>
Nov 14 19:36:48 user nova-compute[75205]:   <name>instance-00000031</name>
Nov 14 19:36:48 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:36:48 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:36:48 user nova-compute[75205]:   <metadata>
Nov 14 19:36:48 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:36:48 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:36:48 user nova-compute[75205]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-461364657</nova:name>
Nov 14 19:36:48 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:36:48</nova:creationTime>
Nov 14 19:36:48 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:36:48 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:36:48 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:36:48 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:36:48 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:36:48 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:36:48 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:36:48 user nova-compute[75205]:       <nova:owner>
Nov 14 19:36:48 user nova-compute[75205]:         <nova:user uuid="73896b6e82ec4503b7ade30ad9174619">tempest-VolumesSnapshotTestJSON-880704583-project-member</nova:user>
Nov 14 19:36:48 user nova-compute[75205]:         <nova:project uuid="e6e76b8a1d6f4df4ad01e87a8bcf1e5d">tempest-VolumesSnapshotTestJSON-880704583</nova:project>
Nov 14 19:36:48 user nova-compute[75205]:       </nova:owner>
Nov 14 19:36:48 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:36:48 user nova-compute[75205]:       <nova:ports>
Nov 14 19:36:48 user nova-compute[75205]:         <nova:port uuid="dafe4984-eec2-43d2-b2f0-9ec6cf50a316">
Nov 14 19:36:48 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 19:36:48 user nova-compute[75205]:         </nova:port>
Nov 14 19:36:48 user nova-compute[75205]:       </nova:ports>
Nov 14 19:36:48 user nova-compute[75205]:     </nova:instance>
Nov 14 19:36:48 user nova-compute[75205]:   </metadata>
Nov 14 19:36:48 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:36:48 user nova-compute[75205]:     <system>
Nov 14 19:36:48 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:36:48 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:36:48 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:36:48 user nova-compute[75205]:       <entry name="serial">a9fcadc7-b19f-43c9-8934-5ef69396348d</entry>
Nov 14 19:36:48 user nova-compute[75205]:       <entry name="uuid">a9fcadc7-b19f-43c9-8934-5ef69396348d</entry>
Nov 14 19:36:48 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:36:48 user nova-compute[75205]:     </system>
Nov 14 19:36:48 user nova-compute[75205]:   </sysinfo>
Nov 14 19:36:48 user nova-compute[75205]:   <os>
Nov 14 19:36:48 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:36:48 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:36:48 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:36:48 user nova-compute[75205]:   </os>
Nov 14 19:36:48 user nova-compute[75205]:   <features>
Nov 14 19:36:48 user nova-compute[75205]:     <acpi/>
Nov 14 19:36:48 user nova-compute[75205]:     <apic/>
Nov 14 19:36:48 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:36:48 user nova-compute[75205]:   </features>
Nov 14 19:36:48 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:36:48 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:36:48 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:36:48 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:36:48 user nova-compute[75205]:   </clock>
Nov 14 19:36:48 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:36:48 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:36:48 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:36:48 user nova-compute[75205]:   </cpu>
Nov 14 19:36:48 user nova-compute[75205]:   <devices>
Nov 14 19:36:48 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:36:48 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:36:48 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk"/>
Nov 14 19:36:48 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:36:48 user nova-compute[75205]:     </disk>
Nov 14 19:36:48 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:36:48 user nova-compute[75205]:       <mac address="fa:16:3e:f3:9c:db"/>
Nov 14 19:36:48 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:36:48 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:36:48 user nova-compute[75205]:       <target dev="tapdafe4984-ee"/>
Nov 14 19:36:48 user nova-compute[75205]:     </interface>
Nov 14 19:36:48 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:36:48 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/console.log" append="off"/>
Nov 14 19:36:48 user nova-compute[75205]:     </serial>
Nov 14 19:36:48 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:36:48 user nova-compute[75205]:     <video>
Nov 14 19:36:48 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:36:48 user nova-compute[75205]:     </video>
Nov 14 19:36:48 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:36:48 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:36:48 user nova-compute[75205]:     </rng>
Nov 14 19:36:48 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:36:48 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:36:48 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:36:48 user nova-compute[75205]:     </memballoon>
Nov 14 19:36:48 user nova-compute[75205]:   </devices>
Nov 14 19:36:48 user nova-compute[75205]: </domain>
Nov 14 19:36:48 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-461364657',display_name='tempest-VolumesSnapshotTestJSON-instance-461364657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-461364657',id=49,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1NniT8VCfqzSNutnIgpKWQPKx/351L01wN8n0a0kyExjFjMrBOCbhIuX7qKlYUs7dB2CDdz72W92sHIO+1eS8df9G79hNJ/NLe7O07kRpDTF3gshBiaR1t+N6/UXXKDQ==',key_name='tempest-keypair-1485353283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6e76b8a1d6f4df4ad01e87a8bcf1e5d',ramdisk_id='',reservation_id='r-d0sdl3uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-880704583',owner_user_name='tempest-VolumesSnapshotTestJSON-880704583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73896b6e82ec4503b7ade30ad9174619',uuid=a9fcadc7-b19f-43c9-8934-5ef69396348d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converting VIF {"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9c:db,bridge_name='br-int',has_traffic_filtering=True,id=dafe4984-eec2-43d2-b2f0-9ec6cf50a316,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdafe4984-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG os_vif [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9c:db,bridge_name='br-int',has_traffic_filtering=True,id=dafe4984-eec2-43d2-b2f0-9ec6cf50a316,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdafe4984-ee') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0daa103c-2b73-5f58-ad34-c92790159071', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdafe4984-ee, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdafe4984-ee, col_values=(('qos', UUID('8458e639-57ca-418d-8a3b-1ca953f3b8fa')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdafe4984-ee, col_values=(('external_ids', {'iface-id': 'dafe4984-eec2-43d2-b2f0-9ec6cf50a316', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:9c:db', 'vm-uuid': 'a9fcadc7-b19f-43c9-8934-5ef69396348d'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:48 user nova-compute[75205]: INFO os_vif [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9c:db,bridge_name='br-int',has_traffic_filtering=True,id=dafe4984-eec2-43d2-b2f0-9ec6cf50a316,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdafe4984-ee')
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] No VIF found with MAC fa:16:3e:f3:9c:db, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating instance_info_cache with network_info: [{"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:36:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:36:49 user nova-compute[75205]: DEBUG nova.network.neutron [req-959a2541-a0ba-4b4c-bb66-45ccf62f8646 req-8b13b586-98f8-4bb9-a9f8-b0367b3aa79e service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Updated VIF entry in instance network info cache for port dafe4984-eec2-43d2-b2f0-9ec6cf50a316. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:36:49 user nova-compute[75205]: DEBUG nova.network.neutron [req-959a2541-a0ba-4b4c-bb66-45ccf62f8646 req-8b13b586-98f8-4bb9-a9f8-b0367b3aa79e service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Updating instance_info_cache with network_info: [{"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:36:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-959a2541-a0ba-4b4c-bb66-45ccf62f8646 req-8b13b586-98f8-4bb9-a9f8-b0367b3aa79e service nova] Releasing lock "refresh_cache-a9fcadc7-b19f-43c9-8934-5ef69396348d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG nova.compute.manager [req-6025541c-df9d-402c-b1cf-94db32a08d9d req-c88a5b84-f651-42a8-9224-14afd4b8c15c service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6025541c-df9d-402c-b1cf-94db32a08d9d req-c88a5b84-f651-42a8-9224-14afd4b8c15c service nova] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6025541c-df9d-402c-b1cf-94db32a08d9d req-c88a5b84-f651-42a8-9224-14afd4b8c15c service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6025541c-df9d-402c-b1cf-94db32a08d9d req-c88a5b84-f651-42a8-9224-14afd4b8c15c service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG nova.compute.manager [req-6025541c-df9d-402c-b1cf-94db32a08d9d req-c88a5b84-f651-42a8-9224-14afd4b8c15c service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] No waiting events found dispatching network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:36:50 user nova-compute[75205]: WARNING nova.compute.manager [req-6025541c-df9d-402c-b1cf-94db32a08d9d req-c88a5b84-f651-42a8-9224-14afd4b8c15c service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received unexpected event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 for instance with vm_state building and task_state spawning.
Nov 14 19:36:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:36:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Instance spawned successfully.
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:36:52 user nova-compute[75205]: INFO nova.compute.manager [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.compute.manager [req-13ff89a3-44f8-4c18-aa39-b733c60bf082 req-4d026006-de83-4eda-abd0-92b07a079f83 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-13ff89a3-44f8-4c18-aa39-b733c60bf082 req-4d026006-de83-4eda-abd0-92b07a079f83 service nova] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-13ff89a3-44f8-4c18-aa39-b733c60bf082 req-4d026006-de83-4eda-abd0-92b07a079f83 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-13ff89a3-44f8-4c18-aa39-b733c60bf082 req-4d026006-de83-4eda-abd0-92b07a079f83 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG nova.compute.manager [req-13ff89a3-44f8-4c18-aa39-b733c60bf082 req-4d026006-de83-4eda-abd0-92b07a079f83 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] No waiting events found dispatching network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:36:52 user nova-compute[75205]: WARNING nova.compute.manager [req-13ff89a3-44f8-4c18-aa39-b733c60bf082 req-4d026006-de83-4eda-abd0-92b07a079f83 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received unexpected event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 for instance with vm_state building and task_state spawning.
Nov 14 19:36:52 user nova-compute[75205]: INFO nova.compute.manager [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Took 5.56 seconds to build instance.
Nov 14 19:36:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-fde2d3d7-abbe-4574-bd5b-ab78ddf66d7a tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.645s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:36:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:36:59 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:37:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:04 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f308e6dd-371b-466a-88d4-1d186fef55d3 is timed out.
Nov 14 19:37:04 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Successfully detached device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the live domain config.
Nov 14 19:37:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUROnJEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:37:04 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe0bbfd-b1e5-48a5-b5ca-16f76bfccfe1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:37:04 user nova-compute[75205]: No targets found.
Nov 14 19:37:04 user nova-compute[75205]: iSNS:
Nov 14 19:37:04 user nova-compute[75205]: No targets found.
Nov 14 19:37:04 user nova-compute[75205]: STATIC:
Nov 14 19:37:04 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d
Nov 14 19:37:04 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:37:04 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:37:04 user nova-compute[75205]: FIRMWARE:
Nov 14 19:37:04 user nova-compute[75205]: No targets found.
Nov 14 19:37:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:37:04 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:37:04 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9529f11-ad7a-421a-a23e-09192383e168]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5f4f8c-c2a5-4f23-8274-f9461d17bfb3]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d (non-flash)
Nov 14 19:37:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d (non-flash)
Nov 14 19:37:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb547d4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37da1f4-2e55-4b6b-84cb-a5abf017eac8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c2bb4d-a765-4028-a6dc-01d55fd6f428]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d35d7a-e4dc-40d3-a2cc-98ba4107f0bd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2da8265-f7e5-4bf0-bd8b-d1dbe2dbc510]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a250fec4-ffa4-44c1-b0ee-44f9fcc185ae]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c25d3e-df60-4680-bd58-86abeb2a3d5e]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d, portal: 172.16.0.220,3260]
Nov 14 19:37:04 user nova-compute[75205]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d, portal: 172.16.0.220,3260] successful.
Nov 14 19:37:04 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10111d7b-836b-44ba-a72a-78159d49084d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee38233-8be7-4d27-9a0d-6c7ade9caaf3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== disconnect_volume: return (280ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:37:04 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:37:05 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:37:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e14a3476-b6ba-4843-84de-08013f95fb2b tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-cbacab9d-2d49-4c96-91db-4a2fb33413db req-4e37c16f-e542-49d4-aae0-e4fe49c4b0f5 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-changed-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:37:25 user nova-compute[75205]: DEBUG nova.compute.manager [req-cbacab9d-2d49-4c96-91db-4a2fb33413db req-4e37c16f-e542-49d4-aae0-e4fe49c4b0f5 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Refreshing instance network info cache due to event network-changed-745822ef-b300-4571-b0e6-392b770bb96c. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:37:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cbacab9d-2d49-4c96-91db-4a2fb33413db req-4e37c16f-e542-49d4-aae0-e4fe49c4b0f5 service nova] Acquiring lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:37:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cbacab9d-2d49-4c96-91db-4a2fb33413db req-4e37c16f-e542-49d4-aae0-e4fe49c4b0f5 service nova] Acquired lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:37:25 user nova-compute[75205]: DEBUG nova.network.neutron [req-cbacab9d-2d49-4c96-91db-4a2fb33413db req-4e37c16f-e542-49d4-aae0-e4fe49c4b0f5 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Refreshing network info cache for port 745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:37:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-cbacab9d-2d49-4c96-91db-4a2fb33413db req-4e37c16f-e542-49d4-aae0-e4fe49c4b0f5 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updated VIF entry in instance network info cache for port 745822ef-b300-4571-b0e6-392b770bb96c. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:37:26 user nova-compute[75205]: DEBUG nova.network.neutron [req-cbacab9d-2d49-4c96-91db-4a2fb33413db req-4e37c16f-e542-49d4-aae0-e4fe49c4b0f5 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating instance_info_cache with network_info: [{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:37:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cbacab9d-2d49-4c96-91db-4a2fb33413db req-4e37c16f-e542-49d4-aae0-e4fe49c4b0f5 service nova] Releasing lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG nova.objects.instance [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:27 user nova-compute[75205]: INFO nova.compute.manager [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Attaching volume 0e679453-a369-4c54-a519-4a9cfcac4da1 to /dev/vdb
Nov 14 19:37:27 user nova-compute[75205]: DEBUG os_brick.utils [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee78dca-e964-4fc7-944e-94262035e51d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c857084-a5cb-4c58-88eb-749a38f0f4b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df5ee1e-23ce-4478-b03d-58c11fdd9909]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dab3d90-67ed-462e-8ad0-d11f657bd248]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:37:27 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:37:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd4855-767a-48be-bead-0c242ed7483e]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG os_brick.utils [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:37:27 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating existing volume attachment record: 7abd7af4-ec8c-4603-8f70-d0d67b09a6c0 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:37:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTFsPCrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:37:32 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:37:32 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:37:32 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985a698-cb22-4a48-bd42-23881e5c7b24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:37:32 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e0c40c-ce1e-4d13-8a92-c7a46c9ab1b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1] added
Nov 14 19:37:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8559c797-5434-4ab0-8bde-75d233788fd6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb4f849-69be-45bd-9cd6-c1488a680a0c]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTFsPCrq {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTFsPCrq" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[688efbc2-40e4-4cfd-a9da-80151bdbfaa4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hTFsPCrq'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[49922a20-df9c-4abb-9a00-3c7345e5ef5a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a6df27-d7e0-44d2-b02a-3cdec0635f0e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:37:32 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:37:32 user nova-compute[75205]:  {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:37:32 user nova-compute[75205]: WARNING os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 19:37:32 user nova-compute[75205]: 
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf07f21-487d-44ee-8396-140d924344aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260]
Nov 14 19:37:32 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260] successful.
Nov 14 19:37:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[db34580f-e672-44e7-b906-a3b06c3584e1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dd54a6-fa67-4034-aab0-0e48ac65d141]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:37:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:37:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[54823522-f0ea-4e12-b6cf-97c1d1dde3da]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:37:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTFsPCrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26134653037303838', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134653037303838', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG nova.objects.instance [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:37:33 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:37:33 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:37:33 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:37:33 user nova-compute[75205]:   <serial>0e679453-a369-4c54-a519-4a9cfcac4da1</serial>
Nov 14 19:37:33 user nova-compute[75205]: </disk>
Nov 14 19:37:33 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No VIF found with MAC fa:16:3e:15:70:50, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-083cfab4-bdd2-401e-84a4-a853ddc3ed96 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.262s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-41112d71-e71c-46cb-9587-fb320fe5c988 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-41112d71-e71c-46cb-9587-fb320fe5c988 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-41112d71-e71c-46cb-9587-fb320fe5c988 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-41112d71-e71c-46cb-9587-fb320fe5c988 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75205) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG nova.objects.instance [None req-41112d71-e71c-46cb-9587-fb320fe5c988 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-d954e508-4786-4af2-a5de-020b2cd8f031 req-8a4b3922-d77c-4724-89d1-3a8254f80f67 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-unplugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d954e508-4786-4af2-a5de-020b2cd8f031 req-8a4b3922-d77c-4724-89d1-3a8254f80f67 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d954e508-4786-4af2-a5de-020b2cd8f031 req-8a4b3922-d77c-4724-89d1-3a8254f80f67 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d954e508-4786-4af2-a5de-020b2cd8f031 req-8a4b3922-d77c-4724-89d1-3a8254f80f67 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-d954e508-4786-4af2-a5de-020b2cd8f031 req-8a4b3922-d77c-4724-89d1-3a8254f80f67 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-unplugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:37:34 user nova-compute[75205]: WARNING nova.compute.manager [req-d954e508-4786-4af2-a5de-020b2cd8f031 req-8a4b3922-d77c-4724-89d1-3a8254f80f67 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-unplugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state active and task_state powering-off.
Nov 14 19:37:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:35 user nova-compute[75205]: INFO nova.compute.manager [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Terminating instance
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.compute.manager [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance destroyed successfully.
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.compute.manager [None req-41112d71-e71c-46cb-9587-fb320fe5c988 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-41112d71-e71c-46cb-9587-fb320fe5c988 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.885s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-9ae51fa1-cd3d-441f-a728-5103408a03bd req-be369f3b-d2f3-4c79-9f34-0ac6b531bd97 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Received event network-vif-unplugged-bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9ae51fa1-cd3d-441f-a728-5103408a03bd req-be369f3b-d2f3-4c79-9f34-0ac6b531bd97 service nova] Acquiring lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9ae51fa1-cd3d-441f-a728-5103408a03bd req-be369f3b-d2f3-4c79-9f34-0ac6b531bd97 service nova] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9ae51fa1-cd3d-441f-a728-5103408a03bd req-be369f3b-d2f3-4c79-9f34-0ac6b531bd97 service nova] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-9ae51fa1-cd3d-441f-a728-5103408a03bd req-be369f3b-d2f3-4c79-9f34-0ac6b531bd97 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] No waiting events found dispatching network-vif-unplugged-bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.compute.manager [req-9ae51fa1-cd3d-441f-a728-5103408a03bd req-be369f3b-d2f3-4c79-9f34-0ac6b531bd97 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Received event network-vif-unplugged-bd98b875-f312-465f-945f-ab4b1e6244da for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:37:35 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Instance destroyed successfully.
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.objects.instance [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lazy-loading 'resources' on Instance uuid f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-66507387',display_name='tempest-VolumesActionsTest-instance-66507387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-66507387',id=48,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68806249c8994e92aa504fe2458bbfa5',ramdisk_id='',reservation_id='r-7fwx0gu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1905321778',owner_user_name='tempest-VolumesActionsTest-1905321778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:35:51Z,user_data=None,user_id='bc437e677797481d8ab81298fb5404ef',uuid=f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd98b875-f312-465f-945f-ab4b1e6244da", "address": "fa:16:3e:d4:0c:27", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd98b875-f3", "ovs_interfaceid": "bd98b875-f312-465f-945f-ab4b1e6244da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converting VIF {"id": "bd98b875-f312-465f-945f-ab4b1e6244da", "address": "fa:16:3e:d4:0c:27", "network": {"id": "4c32083d-4123-45d2-bde0-c2135c1258cd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926122238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68806249c8994e92aa504fe2458bbfa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd98b875-f3", "ovs_interfaceid": "bd98b875-f312-465f-945f-ab4b1e6244da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0c:27,bridge_name='br-int',has_traffic_filtering=True,id=bd98b875-f312-465f-945f-ab4b1e6244da,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd98b875-f3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG os_vif [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0c:27,bridge_name='br-int',has_traffic_filtering=True,id=bd98b875-f312-465f-945f-ab4b1e6244da,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd98b875-f3') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd98b875-f3, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82d5d119-8230-483d-8b3c-bfc49600a1d2) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:35 user nova-compute[75205]: INFO os_vif [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0c:27,bridge_name='br-int',has_traffic_filtering=True,id=bd98b875-f312-465f-945f-ab4b1e6244da,network=Network(4c32083d-4123-45d2-bde0-c2135c1258cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd98b875-f3')
Nov 14 19:37:35 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Deleting instance files /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a_del
Nov 14 19:37:35 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Deletion of /opt/stack/data/nova/instances/f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a_del complete
Nov 14 19:37:35 user nova-compute[75205]: INFO nova.compute.manager [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 19:37:35 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:37:35 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG nova.objects.instance [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:36 user nova-compute[75205]: INFO nova.compute.manager [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attaching volume b527c937-a9e7-4a88-8c83-c4151aa38cba to /dev/vdb
Nov 14 19:37:36 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:37:36 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Took 0.43 seconds to deallocate network for instance.
Nov 14 19:37:36 user nova-compute[75205]: DEBUG os_brick.utils [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[468d5a5d-7c44-4d23-b29a-319e4d0ebb75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd918161-b226-4465-811f-029302509e7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce297348-1c35-45fe-aaa7-5e8a5ca86588]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3384b5-9b7c-446e-81b7-36b560404959]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:37:36 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8901413a-4455-425d-aa66-63c4675bf950]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG os_brick.utils [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating existing volume attachment record: 5df9e168-9cc5-4da2-b1af-4e76690d218d {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG nova.compute.manager [req-569d5876-26df-4564-b9b8-e0fcd9d19773 req-6bd1b7f5-76c7-4c23-831c-550a5ba263b4 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-569d5876-26df-4564-b9b8-e0fcd9d19773 req-6bd1b7f5-76c7-4c23-831c-550a5ba263b4 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-569d5876-26df-4564-b9b8-e0fcd9d19773 req-6bd1b7f5-76c7-4c23-831c-550a5ba263b4 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-569d5876-26df-4564-b9b8-e0fcd9d19773 req-6bd1b7f5-76c7-4c23-831c-550a5ba263b4 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:36 user nova-compute[75205]: DEBUG nova.compute.manager [req-569d5876-26df-4564-b9b8-e0fcd9d19773 req-6bd1b7f5-76c7-4c23-831c-550a5ba263b4 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:37:36 user nova-compute[75205]: WARNING nova.compute.manager [req-569d5876-26df-4564-b9b8-e0fcd9d19773 req-6bd1b7f5-76c7-4c23-831c-550a5ba263b4 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state stopped and task_state None.
Nov 14 19:37:36 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Deleted allocations for instance f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a
Nov 14 19:37:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-676c4dcb-1d61-493f-a46f-7826e3b52e3b tempest-VolumesActionsTest-1905321778 tempest-VolumesActionsTest-1905321778-project-member] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.736s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-02f7d11c-1f87-40e2-8ed0-cd4acb7c4332 req-ac8a7abd-2be8-4c98-bc6a-c2bf1b925cc1 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Received event network-vif-plugged-bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:37:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-02f7d11c-1f87-40e2-8ed0-cd4acb7c4332 req-ac8a7abd-2be8-4c98-bc6a-c2bf1b925cc1 service nova] Acquiring lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-02f7d11c-1f87-40e2-8ed0-cd4acb7c4332 req-ac8a7abd-2be8-4c98-bc6a-c2bf1b925cc1 service nova] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-02f7d11c-1f87-40e2-8ed0-cd4acb7c4332 req-ac8a7abd-2be8-4c98-bc6a-c2bf1b925cc1 service nova] Lock "f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-02f7d11c-1f87-40e2-8ed0-cd4acb7c4332 req-ac8a7abd-2be8-4c98-bc6a-c2bf1b925cc1 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] No waiting events found dispatching network-vif-plugged-bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:37:37 user nova-compute[75205]: WARNING nova.compute.manager [req-02f7d11c-1f87-40e2-8ed0-cd4acb7c4332 req-ac8a7abd-2be8-4c98-bc6a-c2bf1b925cc1 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Received unexpected event network-vif-plugged-bd98b875-f312-465f-945f-ab4b1e6244da for instance with vm_state deleted and task_state None.
Nov 14 19:37:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-02f7d11c-1f87-40e2-8ed0-cd4acb7c4332 req-ac8a7abd-2be8-4c98-bc6a-c2bf1b925cc1 service nova] [instance: f8adf7eb-f40c-4e63-b5b4-7f1d69989a4a] Received event network-vif-deleted-bd98b875-f312-465f-945f-ab4b1e6244da {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:37:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeKiHnbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:37:40 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:37:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:37:40 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:37:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:37:40 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:37:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e04effe-d324-4fcc-847d-9e88ffb9a7f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:37:40 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb3229b-b8e5-40ca-8bcd-ac02e0e9f4d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba] added
Nov 14 19:37:40 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928546e-794e-48e2-b410-c88996d67e60]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad1727-1e80-4881-81b2-89fbf5fb995f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YeKiHnbI {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YeKiHnbI" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b6d55c-7bb8-480d-b21d-19291cd0ef5f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YeKiHnbI'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab18718-3723-4ebb-899c-c4866286738e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea782b1-75d7-40db-8c05-bcc240e11bf4]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:37:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:37:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa3e7a8-3cc5-47f2-874f-499aab5d0783]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba, portal: 172.16.0.220,3260]
Nov 14 19:37:41 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba, portal: 172.16.0.220,3260] successful.
Nov 14 19:37:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fea72d-6560-4cbc-850a-c2608760e1d2]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec10057-fa19-43a5-b2a6-25fbee5d050f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:37:41 user nova-compute[75205]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba (non-flash)
Nov 14 19:37:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:37:41 user nova-compute[75205]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba (non-flash)
Nov 14 19:37:41 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab26604-126b-4d3e-9c78-d7d987a8b889]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:37:41 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeKiHnbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:37:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:37:42 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23665343661363737', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:37:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665343661363737', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:37:42 user nova-compute[75205]: DEBUG nova.objects.instance [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:37:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:37:42 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:37:42 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:37:42 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:37:42 user nova-compute[75205]:   <serial>b527c937-a9e7-4a88-8c83-c4151aa38cba</serial>
Nov 14 19:37:42 user nova-compute[75205]: </disk>
Nov 14 19:37:42 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:37:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:37:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:37:42 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No VIF found with MAC fa:16:3e:8c:ac:75, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:37:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-720e2fa1-74a4-43a4-825f-9907eb65f8ca tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.468s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:37:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:45 user nova-compute[75205]: INFO nova.compute.manager [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Detaching volume b527c937-a9e7-4a88-8c83-c4151aa38cba
Nov 14 19:37:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:37:45 user nova-compute[75205]: INFO nova.virt.block_device [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attempting to driver detach volume b527c937-a9e7-4a88-8c83-c4151aa38cba from mountpoint /dev/vdb
Nov 14 19:37:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Attempting to detach device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:37:45 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:37:45 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:37:45 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:37:45 user nova-compute[75205]:   <serial>b527c937-a9e7-4a88-8c83-c4151aa38cba</serial>
Nov 14 19:37:45 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:37:45 user nova-compute[75205]: </disk>
Nov 14 19:37:45 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:37:45 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Successfully detached device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the persistent domain config.
Nov 14 19:37:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:37:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:37:45 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:37:45 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:37:45 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:37:45 user nova-compute[75205]:   <serial>b527c937-a9e7-4a88-8c83-c4151aa38cba</serial>
Nov 14 19:37:45 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:37:45 user nova-compute[75205]: </disk>
Nov 14 19:37:45 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:37:46 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:37:46 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:37:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=25.069496154785156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance f308e6dd-371b-466a-88d4-1d186fef55d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance a9fcadc7-b19f-43c9-8934-5ef69396348d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:37:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:37:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:37:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:37:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:37:49 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:37:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:37:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:37:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:37:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:37:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:37:50 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating instance_info_cache with network_info: [{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:37:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:37:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:37:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:37:52 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:37:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:37:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:37:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:37:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:37:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:37:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:37:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:06 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f308e6dd-371b-466a-88d4-1d186fef55d3 is timed out.
Nov 14 19:38:06 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Successfully detached device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the live domain config.
Nov 14 19:38:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeKiHnbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:38:06 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9b061f-c0b2-4810-be96-78416135befe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:38:06 user nova-compute[75205]: No targets found.
Nov 14 19:38:06 user nova-compute[75205]: iSNS:
Nov 14 19:38:06 user nova-compute[75205]: No targets found.
Nov 14 19:38:06 user nova-compute[75205]: STATIC:
Nov 14 19:38:06 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba
Nov 14 19:38:06 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:38:06 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:38:06 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1
Nov 14 19:38:06 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:38:06 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:38:06 user nova-compute[75205]: FIRMWARE:
Nov 14 19:38:06 user nova-compute[75205]: No targets found.
Nov 14 19:38:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:38:06 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:38:06 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f59cba9-a688-47bd-b01d-f3502768da4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7d2f45-b1a3-4605-bb42-350f18ae78bb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:38:06 user nova-compute[75205]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba (non-flash)
Nov 14 19:38:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:38:06 user nova-compute[75205]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba (non-flash)
Nov 14 19:38:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb74116200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cb56dd-4710-4adb-8d1a-31e4a35ec79c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad3b5a-1b52-4f22-a982-f2d1e23acf94]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0969e5a8-0045-4f54-addf-3844826b09e3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd7e206-bc4a-4af3-84a8-d7bb696e97a4]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c844ea0-b49d-4e06-8ef5-a4ecd7cc42c8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[803e1d20-1747-4da9-83a6-36c30c0c4b37]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba, portal: 172.16.0.220,3260]
Nov 14 19:38:06 user nova-compute[75205]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba, portal: 172.16.0.220,3260] successful.
Nov 14 19:38:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b527c937-a9e7-4a88-8c83-c4151aa38cba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c704cd-1895-48a2-8bbd-467f9f6eca60]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== disconnect_volume: return (334ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:38:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:38:07 user nova-compute[75205]: DEBUG nova.objects.instance [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:38:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-29793008-0d0c-42d6-90d2-309d587cfa78 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.900s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:38:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:38:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:38:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:38:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:38:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:38:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:38:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:38:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG nova.objects.instance [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-d151da96-9cd4-4de8-a51e-e1541dccdc9c req-eafa0663-760e-4703-8c46-b07b903f49c1 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-changed-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG nova.compute.manager [req-d151da96-9cd4-4de8-a51e-e1541dccdc9c req-eafa0663-760e-4703-8c46-b07b903f49c1 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Refreshing instance network info cache due to event network-changed-dafe4984-eec2-43d2-b2f0-9ec6cf50a316. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d151da96-9cd4-4de8-a51e-e1541dccdc9c req-eafa0663-760e-4703-8c46-b07b903f49c1 service nova] Acquiring lock "refresh_cache-a9fcadc7-b19f-43c9-8934-5ef69396348d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d151da96-9cd4-4de8-a51e-e1541dccdc9c req-eafa0663-760e-4703-8c46-b07b903f49c1 service nova] Acquired lock "refresh_cache-a9fcadc7-b19f-43c9-8934-5ef69396348d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG nova.network.neutron [req-d151da96-9cd4-4de8-a51e-e1541dccdc9c req-eafa0663-760e-4703-8c46-b07b903f49c1 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Refreshing network info cache for port dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:38:37 user nova-compute[75205]: INFO nova.compute.manager [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attaching volume bc1855c8-a0b9-4ea5-a141-830724225266 to /dev/vdb
Nov 14 19:38:37 user nova-compute[75205]: DEBUG os_brick.utils [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc5e1f0-b370-46a3-844c-945380d25f74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15cf097-1f9a-4fdf-86f3-4fda7a6ccdbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ad0b12-ccfb-4ee9-aeb5-e4b680879bd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b600d04a-cbab-4f19-bcc9-d6576cd5c677]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:38:38 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2743331e-8b7a-43bb-bd78-7899cf4b9a8f]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG os_brick.utils [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating existing volume attachment record: e7a75529-c21c-4886-84f3-0254029926dd {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG nova.objects.instance [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lazy-loading 'flavor' on Instance uuid a9fcadc7-b19f-43c9-8934-5ef69396348d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:38:38 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Ignoring supplied device name: /dev/vdb
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.253s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG nova.network.neutron [req-d151da96-9cd4-4de8-a51e-e1541dccdc9c req-eafa0663-760e-4703-8c46-b07b903f49c1 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Updated VIF entry in instance network info cache for port dafe4984-eec2-43d2-b2f0-9ec6cf50a316. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG nova.network.neutron [req-d151da96-9cd4-4de8-a51e-e1541dccdc9c req-eafa0663-760e-4703-8c46-b07b903f49c1 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Updating instance_info_cache with network_info: [{"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:38:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d151da96-9cd4-4de8-a51e-e1541dccdc9c req-eafa0663-760e-4703-8c46-b07b903f49c1 service nova] Releasing lock "refresh_cache-a9fcadc7-b19f-43c9-8934-5ef69396348d" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:38:39 user nova-compute[75205]: INFO nova.compute.manager [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Attaching volume e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a to /dev/vdb
Nov 14 19:38:39 user nova-compute[75205]: DEBUG os_brick.utils [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb5ac3e-7027-499c-935f-3225b11fa47b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad83aca2-0d93-4358-8ba7-7e3d219be455]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[213f0659-a7f6-4ec5-be46-ff1ec78e546f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[293d27f6-9e0e-42b8-b738-c8b7a9a89265]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:38:39 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:38:39 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c60c3c-cdfc-4680-8ad7-fea0aa93f427]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG os_brick.utils [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:38:39 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Updating existing volume attachment record: d2a4c75d-01f0-47fb-96e8-305ee74d4043 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:38:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBoFAWZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:38:43 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:38:43 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:38:43 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb37711-967a-494b-a5a2-63fbeb23ab18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:38:43 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ed90d7-c554-460c-b7c0-712083aa299d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266] added
Nov 14 19:38:43 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0905f992-2384-4880-9d37-1c7e8a20375a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b46d244-2f4d-4287-8f45-19a6cb86b225]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBoFAWZv {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBoFAWZv" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abe0953-fe76-4014-be15-7c4234b5a1d6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LBoFAWZv'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ced2dd7-f1bc-4620-8f77-4c0292ed85ff]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[158f66b4-87a3-47f7-8bc8-b597aae2898b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:38:43 user nova-compute[75205]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)
Nov 14 19:38:43 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:38:43 user nova-compute[75205]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)
Nov 14 19:38:43 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffcedae-6cda-45a8-b8f5-438bfe0c2e92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266, portal: 172.16.0.220,3260]
Nov 14 19:38:43 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266, portal: 172.16.0.220,3260] successful.
Nov 14 19:38:43 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bb9580-3148-4d04-a6f9-35b58edc9d55]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecab2e6b-3fcb-47fb-a4ea-2afcd1d2b874]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:38:43 user nova-compute[75205]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)
Nov 14 19:38:43 user nova-compute[75205]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)
Nov 14 19:38:43 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:38:43 user nova-compute[75205]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)
Nov 14 19:38:43 user nova-compute[75205]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)
Nov 14 19:38:43 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f5e37d-f997-4db2-94ce-09b478e8d6fd]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:38:43 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBoFAWZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTmfOJqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:38:44 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26661613835653631', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661613835653631', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.016s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:38:44 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:38:44 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG nova.objects.instance [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffe7ffd-65ee-40fc-ae1e-42fe02a87497]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:38:44 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:38:44 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:38:44 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:38:44 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:38:44 user nova-compute[75205]:   <serial>bc1855c8-a0b9-4ea5-a141-830724225266</serial>
Nov 14 19:38:44 user nova-compute[75205]: </disk>
Nov 14 19:38:44 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8c4b5a-71c0-4ec7-b5ec-de174f4f2f74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a] added
Nov 14 19:38:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55ba72e-a7fa-49c4-bd7b-ef47c44d9e4e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[62220777-3752-4000-84da-6c0cf20079d8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTmfOJqw {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTmfOJqw" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4a8c6b-ca67-430e-bc99-b7540c0a1cb6]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gTmfOJqw'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffccfd6-aa68-4f51-8d73-6061faeeccf9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[52db6fd0-b978-4b28-8d11-f77d67408b0c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:38:44 user nova-compute[75205]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)
Nov 14 19:38:44 user nova-compute[75205]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)
Nov 14 19:38:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:38:44 user nova-compute[75205]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)
Nov 14 19:38:44 user nova-compute[75205]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)
Nov 14 19:38:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:38:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No VIF found with MAC fa:16:3e:8c:ac:75, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-1990b8c5-8e62-4506-a972-9b9bde546124 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.492s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --login" returned: 0 in 1.073s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6cc054-980c-43fd-b336-a18731849ca7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a, portal: 172.16.0.220,3260]
Nov 14 19:38:45 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a, portal: 172.16.0.220,3260] successful.
Nov 14 19:38:45 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d3df9c-01c7-495a-8f4d-23a7ff48b20f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa735e0e-91df-46eb-af12-6a4feb514b85]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:38:45 user nova-compute[75205]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)
Nov 14 19:38:45 user nova-compute[75205]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)
Nov 14 19:38:45 user nova-compute[75205]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a (non-flash)
Nov 14 19:38:45 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:38:45 user nova-compute[75205]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301d18c5-6152-4927-bc3e-cef1adec8ee6 (non-flash)
Nov 14 19:38:45 user nova-compute[75205]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)
Nov 14 19:38:45 user nova-compute[75205]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a (non-flash)
Nov 14 19:38:45 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.335s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afb9258-6d18-4bc4-a683-fbd309b93e1f]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:38:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:38:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:38:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTmfOJqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.822s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] <== connect_volume: return (2838ms) {'type': 'block', 'scsi_wwn': '23064363962323039', 'path': '/dev/sde'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064363962323039', 'path': '/dev/sde'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:38:47 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:38:47 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=24.318565368652344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.objects.instance [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lazy-loading 'flavor' on Instance uuid a9fcadc7-b19f-43c9-8934-5ef69396348d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:38:47 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:38:47 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:38:47 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:38:47 user nova-compute[75205]:   <serial>e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a</serial>
Nov 14 19:38:47 user nova-compute[75205]: </disk>
Nov 14 19:38:47 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance f308e6dd-371b-466a-88d4-1d186fef55d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance a9fcadc7-b19f-43c9-8934-5ef69396348d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:38:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.708s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:38:48 user nova-compute[75205]: INFO nova.compute.manager [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Detaching volume bc1855c8-a0b9-4ea5-a141-830724225266
Nov 14 19:38:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] No VIF found with MAC fa:16:3e:f3:9c:db, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:38:48 user nova-compute[75205]: INFO nova.virt.block_device [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attempting to driver detach volume bc1855c8-a0b9-4ea5-a141-830724225266 from mountpoint /dev/vdb
Nov 14 19:38:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Attempting to detach device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:38:48 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:38:48 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:38:48 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:38:48 user nova-compute[75205]:   <serial>bc1855c8-a0b9-4ea5-a141-830724225266</serial>
Nov 14 19:38:48 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:38:48 user nova-compute[75205]: </disk>
Nov 14 19:38:48 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:38:48 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Successfully detached device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the persistent domain config.
Nov 14 19:38:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:38:48 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:38:48 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:38:48 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:38:48 user nova-compute[75205]:   <serial>bc1855c8-a0b9-4ea5-a141-830724225266</serial>
Nov 14 19:38:48 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:38:48 user nova-compute[75205]: </disk>
Nov 14 19:38:48 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-4c421d26-360b-46be-8633-7972e99774b5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.341s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:38:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:38:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:38:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:38:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:38:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:38:52 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:38:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:53 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:38:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:38:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:38:55 user nova-compute[75205]: INFO nova.compute.manager [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Detaching volume e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a
Nov 14 19:38:55 user nova-compute[75205]: INFO nova.virt.block_device [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Attempting to driver detach volume e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a from mountpoint /dev/vdb
Nov 14 19:38:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Attempting to detach device vdb from instance a9fcadc7-b19f-43c9-8934-5ef69396348d from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:38:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:38:55 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:38:55 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:38:55 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:38:55 user nova-compute[75205]:   <serial>e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a</serial>
Nov 14 19:38:55 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:38:55 user nova-compute[75205]: </disk>
Nov 14 19:38:55 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:38:55 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Successfully detached device vdb from instance a9fcadc7-b19f-43c9-8934-5ef69396348d from the persistent domain config.
Nov 14 19:38:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9fcadc7-b19f-43c9-8934-5ef69396348d from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:38:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:38:55 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:38:55 user nova-compute[75205]:   <source dev="/dev/sde"/>
Nov 14 19:38:55 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:38:55 user nova-compute[75205]:   <serial>e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a</serial>
Nov 14 19:38:55 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:38:55 user nova-compute[75205]: </disk>
Nov 14 19:38:55 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:38:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:38:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9fcadc7-b19f-43c9-8934-5ef69396348d {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:38:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:38:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:03 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:09 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f308e6dd-371b-466a-88d4-1d186fef55d3 is timed out.
Nov 14 19:39:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Successfully detached device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the live domain config.
Nov 14 19:39:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBoFAWZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:39:09 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[380ab7c9-a2bc-4e56-868d-d08b32e37021]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:39:09 user nova-compute[75205]: No targets found.
Nov 14 19:39:09 user nova-compute[75205]: iSNS:
Nov 14 19:39:09 user nova-compute[75205]: No targets found.
Nov 14 19:39:09 user nova-compute[75205]: STATIC:
Nov 14 19:39:09 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266
Nov 14 19:39:09 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:39:09 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:39:09 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1
Nov 14 19:39:09 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:39:09 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:39:09 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a
Nov 14 19:39:09 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:39:09 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:39:09 user nova-compute[75205]: FIRMWARE:
Nov 14 19:39:09 user nova-compute[75205]: No targets found.
Nov 14 19:39:09 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:39:09 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:39:09 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9f3e36-2b22-4cd1-bb4b-682995af101f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae04ba9-07d0-4e44-82ca-f00d358a3934]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:09 user nova-compute[75205]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)
Nov 14 19:39:09 user nova-compute[75205]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a (non-flash)
Nov 14 19:39:09 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:09 user nova-compute[75205]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 (non-flash)
Nov 14 19:39:09 user nova-compute[75205]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a (non-flash)
Nov 14 19:39:09 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb741d0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266'): ({'sdd'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Removing single pathed devices sdd {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fea439-b697-499e-bd4f-df73719de6d7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d2e1a2-6aac-4d01-a5fe-20e0bf041463]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Flushing IO for device /dev/sdd {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca3773-c541-4dd0-b24c-16882d4e9a88]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31404d6-717b-42c0-bb2e-c5fde33bef20]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[42be8c50-f6d5-41c3-a102-589eb4ba7420]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18f5a97-684a-434d-8785-8446c7f2aebc]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266, portal: 172.16.0.220,3260]
Nov 14 19:39:09 user nova-compute[75205]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266, portal: 172.16.0.220,3260] successful.
Nov 14 19:39:09 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1855c8-a0b9-4ea5-a141-830724225266 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8786276e-6369-4777-ad55-b5a9fcd9d331]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== disconnect_volume: return (319ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:39:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:10 user nova-compute[75205]: DEBUG nova.objects.instance [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d82879e7-a1e6-447f-847b-9d935bd66a67 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.050s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:39:13 user nova-compute[75205]: INFO nova.compute.claims [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Claim successful on node user
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.network.neutron [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:39:13 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.policy [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '949d766f59384494943cb27d5bbc3b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d749beb4f34d2fafa10b4a3cdbab88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:39:13 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Creating image(s)
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "/opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "/opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "ea18f65a942ff031ac519d01b6bb77e340d70ffb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "ea18f65a942ff031ac519d01b6bb77e340d70ffb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb.part --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:14 user nova-compute[75205]: DEBUG nova.network.neutron [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Successfully created port: 96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:39:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:14 user nova-compute[75205]: DEBUG nova.virt.images [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] 73c45d86-1d4b-4749-ba39-4186e7c098f8 was qcow2, converting to raw {{(pid=75205) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 19:39:14 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:39:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb.part /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb.converted {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb.part /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb.converted" returned: 0 in 0.337s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb.converted --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb.converted --force-share --output=json" returned: 0 in 0.314s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "ea18f65a942ff031ac519d01b6bb77e340d70ffb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.243s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb --force-share --output=json" returned: 0 in 0.190s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "ea18f65a942ff031ac519d01b6bb77e340d70ffb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "ea18f65a942ff031ac519d01b6bb77e340d70ffb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.neutron [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Successfully updated port: 96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquired lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.neutron [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.compute.manager [req-08539d42-b40c-4aee-8ac6-fac22eea0fbc req-cd5d65ca-b93d-424f-a42c-12ad1ab7b5ce service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-changed-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.compute.manager [req-08539d42-b40c-4aee-8ac6-fac22eea0fbc req-cd5d65ca-b93d-424f-a42c-12ad1ab7b5ce service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Refreshing instance network info cache due to event network-changed-96fe9173-4e8b-435c-abc7-58a88afe1e39. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-08539d42-b40c-4aee-8ac6-fac22eea0fbc req-cd5d65ca-b93d-424f-a42c-12ad1ab7b5ce service nova] Acquiring lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.neutron [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb --force-share --output=json" returned: 0 in 0.231s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb,backing_fmt=raw /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb,backing_fmt=raw /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk 1073741824" returned: 0 in 0.046s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "ea18f65a942ff031ac519d01b6bb77e340d70ffb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.neutron [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Releasing lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Instance network_info: |[{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-08539d42-b40c-4aee-8ac6-fac22eea0fbc req-cd5d65ca-b93d-424f-a42c-12ad1ab7b5ce service nova] Acquired lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.neutron [req-08539d42-b40c-4aee-8ac6-fac22eea0fbc req-cd5d65ca-b93d-424f-a42c-12ad1ab7b5ce service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Refreshing network info cache for port 96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Cannot resize image /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Ensure instance console log exists: /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Start _get_guest_xml network_info=[{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:39:10Z,direct_url=<?>,disk_format='qcow2',id=73c45d86-1d4b-4749-ba39-4186e7c098f8,min_disk=0,min_ram=0,name='tempest-scenario-img--741249874',owner='32d749beb4f34d2fafa10b4a3cdbab88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:39:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '73c45d86-1d4b-4749-ba39-4186e7c098f8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:39:15 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:39:15 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:39:10Z,direct_url=<?>,disk_format='qcow2',id=73c45d86-1d4b-4749-ba39-4186e7c098f8,min_disk=0,min_ram=0,name='tempest-scenario-img--741249874',owner='32d749beb4f34d2fafa10b4a3cdbab88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:39:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-659509003',display_name='tempest-TestMinimumBasicScenario-server-659509003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-659509003',id=50,image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoRxAXyyRyvp4ISDz44uTTzcyrFRN+Y/Y6dglFi6JGQNUuyn0u6gRZz/CVA0g0KRYfKYzktzAwrrjSC37i4fwtYzQQQ6rSDkDkgIucLmh36ObtAppZg7HW21KcMeNUJSA==',key_name='tempest-TestMinimumBasicScenario-1815893540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d749beb4f34d2fafa10b4a3cdbab88',ramdisk_id='',reservation_id='r-o6g8z44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-400789003',owner_user_name='tempest-TestMinimumBasicScenario-400789003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:39:14Z,user_data=None,user_id='949d766f59384494943cb27d5bbc3b95',uuid=3b69180c-5fb5-43b8-92ea-1cce7b036da9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converting VIF {"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.objects.instance [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:39:15 user nova-compute[75205]:   <uuid>3b69180c-5fb5-43b8-92ea-1cce7b036da9</uuid>
Nov 14 19:39:15 user nova-compute[75205]:   <name>instance-00000032</name>
Nov 14 19:39:15 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:39:15 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:39:15 user nova-compute[75205]:   <metadata>
Nov 14 19:39:15 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:39:15 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:39:15 user nova-compute[75205]:       <nova:name>tempest-TestMinimumBasicScenario-server-659509003</nova:name>
Nov 14 19:39:15 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:39:15</nova:creationTime>
Nov 14 19:39:15 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:39:15 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:39:15 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:39:15 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:39:15 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:39:15 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:39:15 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:39:15 user nova-compute[75205]:       <nova:owner>
Nov 14 19:39:15 user nova-compute[75205]:         <nova:user uuid="949d766f59384494943cb27d5bbc3b95">tempest-TestMinimumBasicScenario-400789003-project-member</nova:user>
Nov 14 19:39:15 user nova-compute[75205]:         <nova:project uuid="32d749beb4f34d2fafa10b4a3cdbab88">tempest-TestMinimumBasicScenario-400789003</nova:project>
Nov 14 19:39:15 user nova-compute[75205]:       </nova:owner>
Nov 14 19:39:15 user nova-compute[75205]:       <nova:root type="image" uuid="73c45d86-1d4b-4749-ba39-4186e7c098f8"/>
Nov 14 19:39:15 user nova-compute[75205]:       <nova:ports>
Nov 14 19:39:15 user nova-compute[75205]:         <nova:port uuid="96fe9173-4e8b-435c-abc7-58a88afe1e39">
Nov 14 19:39:15 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 19:39:15 user nova-compute[75205]:         </nova:port>
Nov 14 19:39:15 user nova-compute[75205]:       </nova:ports>
Nov 14 19:39:15 user nova-compute[75205]:     </nova:instance>
Nov 14 19:39:15 user nova-compute[75205]:   </metadata>
Nov 14 19:39:15 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:39:15 user nova-compute[75205]:     <system>
Nov 14 19:39:15 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:39:15 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:39:15 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:39:15 user nova-compute[75205]:       <entry name="serial">3b69180c-5fb5-43b8-92ea-1cce7b036da9</entry>
Nov 14 19:39:15 user nova-compute[75205]:       <entry name="uuid">3b69180c-5fb5-43b8-92ea-1cce7b036da9</entry>
Nov 14 19:39:15 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:39:15 user nova-compute[75205]:     </system>
Nov 14 19:39:15 user nova-compute[75205]:   </sysinfo>
Nov 14 19:39:15 user nova-compute[75205]:   <os>
Nov 14 19:39:15 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:39:15 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:39:15 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:39:15 user nova-compute[75205]:   </os>
Nov 14 19:39:15 user nova-compute[75205]:   <features>
Nov 14 19:39:15 user nova-compute[75205]:     <acpi/>
Nov 14 19:39:15 user nova-compute[75205]:     <apic/>
Nov 14 19:39:15 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:39:15 user nova-compute[75205]:   </features>
Nov 14 19:39:15 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:39:15 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:39:15 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:39:15 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:39:15 user nova-compute[75205]:   </clock>
Nov 14 19:39:15 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:39:15 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:39:15 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:39:15 user nova-compute[75205]:   </cpu>
Nov 14 19:39:15 user nova-compute[75205]:   <devices>
Nov 14 19:39:15 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:39:15 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:39:15 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk"/>
Nov 14 19:39:15 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:39:15 user nova-compute[75205]:     </disk>
Nov 14 19:39:15 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:39:15 user nova-compute[75205]:       <mac address="fa:16:3e:70:39:e6"/>
Nov 14 19:39:15 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:39:15 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:39:15 user nova-compute[75205]:       <target dev="tap96fe9173-4e"/>
Nov 14 19:39:15 user nova-compute[75205]:     </interface>
Nov 14 19:39:15 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:39:15 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/console.log" append="off"/>
Nov 14 19:39:15 user nova-compute[75205]:     </serial>
Nov 14 19:39:15 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:39:15 user nova-compute[75205]:     <video>
Nov 14 19:39:15 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:39:15 user nova-compute[75205]:     </video>
Nov 14 19:39:15 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:39:15 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:39:15 user nova-compute[75205]:     </rng>
Nov 14 19:39:15 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:39:15 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:39:15 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:39:15 user nova-compute[75205]:     </memballoon>
Nov 14 19:39:15 user nova-compute[75205]:   </devices>
Nov 14 19:39:15 user nova-compute[75205]: </domain>
Nov 14 19:39:15 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-659509003',display_name='tempest-TestMinimumBasicScenario-server-659509003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-659509003',id=50,image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoRxAXyyRyvp4ISDz44uTTzcyrFRN+Y/Y6dglFi6JGQNUuyn0u6gRZz/CVA0g0KRYfKYzktzAwrrjSC37i4fwtYzQQQ6rSDkDkgIucLmh36ObtAppZg7HW21KcMeNUJSA==',key_name='tempest-TestMinimumBasicScenario-1815893540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d749beb4f34d2fafa10b4a3cdbab88',ramdisk_id='',reservation_id='r-o6g8z44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-400789003',owner_user_name='tempest-TestMinimumBasicScenario-400789003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:39:14Z,user_data=None,user_id='949d766f59384494943cb27d5bbc3b95',uuid=3b69180c-5fb5-43b8-92ea-1cce7b036da9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converting VIF {"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG os_vif [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3504a7c4-9a77-5e14-ae27-138de02f2d40', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96fe9173-4e, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96fe9173-4e, col_values=(('qos', UUID('79e89aa8-6fde-4b34-b611-a31a8014a0b6')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96fe9173-4e, col_values=(('external_ids', {'iface-id': '96fe9173-4e8b-435c-abc7-58a88afe1e39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:39:e6', 'vm-uuid': '3b69180c-5fb5-43b8-92ea-1cce7b036da9'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:15 user nova-compute[75205]: INFO os_vif [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e')
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] No VIF found with MAC fa:16:3e:70:39:e6, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.neutron [req-08539d42-b40c-4aee-8ac6-fac22eea0fbc req-cd5d65ca-b93d-424f-a42c-12ad1ab7b5ce service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updated VIF entry in instance network info cache for port 96fe9173-4e8b-435c-abc7-58a88afe1e39. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG nova.network.neutron [req-08539d42-b40c-4aee-8ac6-fac22eea0fbc req-cd5d65ca-b93d-424f-a42c-12ad1ab7b5ce service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:39:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-08539d42-b40c-4aee-8ac6-fac22eea0fbc req-cd5d65ca-b93d-424f-a42c-12ad1ab7b5ce service nova] Releasing lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:39:16 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a9fcadc7-b19f-43c9-8934-5ef69396348d is timed out.
Nov 14 19:39:16 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Successfully detached device vdb from instance a9fcadc7-b19f-43c9-8934-5ef69396348d from the live domain config.
Nov 14 19:39:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTmfOJqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:39:16 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdb3379-275f-4021-96ec-7e9fcce48f01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:39:16 user nova-compute[75205]: No targets found.
Nov 14 19:39:16 user nova-compute[75205]: iSNS:
Nov 14 19:39:16 user nova-compute[75205]: No targets found.
Nov 14 19:39:16 user nova-compute[75205]: STATIC:
Nov 14 19:39:16 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1
Nov 14 19:39:16 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:39:16 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:39:16 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a
Nov 14 19:39:16 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:39:16 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:39:16 user nova-compute[75205]: FIRMWARE:
Nov 14 19:39:16 user nova-compute[75205]: No targets found.
Nov 14 19:39:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:39:16 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:39:16 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd34e461-715c-4aad-9721-19e4eb7a8fd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2719c5b4-7238-4e9b-a5d5-82f625199e39]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:16 user nova-compute[75205]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a (non-flash)
Nov 14 19:39:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:16 user nova-compute[75205]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a (non-flash)
Nov 14 19:39:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb9423a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a'): ({'sde'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Removing single pathed devices sde {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220bdd9-ea7c-4d49-bf1a-bf87a1bf19cd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[344dda3d-8e27-46c6-acfc-766d2ad7efc5]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Flushing IO for device /dev/sde {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7b40a8-7860-422c-98a4-bfb6c4b1d169]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[182a696a-174a-484b-8c5a-7623f06ec922]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] SCSI volumes sde have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c110e7-1dec-448c-bdec-8a723621bf1f]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ce6f95-0240-4bd9-8ecf-80ee12894dd4]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a, portal: 172.16.0.220,3260]
Nov 14 19:39:16 user nova-compute[75205]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a, portal: 172.16.0.220,3260] successful.
Nov 14 19:39:16 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6db91d2-e3ab-482b-93e3-f1e893228fe4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] <== disconnect_volume: return (281ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:39:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.objects.instance [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lazy-loading 'flavor' on Instance uuid a9fcadc7-b19f-43c9-8934-5ef69396348d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-798c8143-eb66-42c8-b7da-b57591a316f5 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.695s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.587s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:17 user nova-compute[75205]: INFO nova.compute.manager [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Terminating instance
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.compute.manager [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-2b9005f6-b7ea-4daf-a4d5-ee37affa6e99 req-c786f747-3a4e-4c37-8a22-98e958b52493 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2b9005f6-b7ea-4daf-a4d5-ee37affa6e99 req-c786f747-3a4e-4c37-8a22-98e958b52493 service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2b9005f6-b7ea-4daf-a4d5-ee37affa6e99 req-c786f747-3a4e-4c37-8a22-98e958b52493 service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2b9005f6-b7ea-4daf-a4d5-ee37affa6e99 req-c786f747-3a4e-4c37-8a22-98e958b52493 service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-2b9005f6-b7ea-4daf-a4d5-ee37affa6e99 req-c786f747-3a4e-4c37-8a22-98e958b52493 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:39:17 user nova-compute[75205]: WARNING nova.compute.manager [req-2b9005f6-b7ea-4daf-a4d5-ee37affa6e99 req-c786f747-3a4e-4c37-8a22-98e958b52493 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state building and task_state spawning.
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-b9371cec-d0ff-44e9-aec3-f3a5d6c68d0f req-3c11ae9d-5713-4697-9496-877e428685bf service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-vif-unplugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b9371cec-d0ff-44e9-aec3-f3a5d6c68d0f req-3c11ae9d-5713-4697-9496-877e428685bf service nova] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b9371cec-d0ff-44e9-aec3-f3a5d6c68d0f req-3c11ae9d-5713-4697-9496-877e428685bf service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b9371cec-d0ff-44e9-aec3-f3a5d6c68d0f req-3c11ae9d-5713-4697-9496-877e428685bf service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-b9371cec-d0ff-44e9-aec3-f3a5d6c68d0f req-3c11ae9d-5713-4697-9496-877e428685bf service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] No waiting events found dispatching network-vif-unplugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-b9371cec-d0ff-44e9-aec3-f3a5d6c68d0f req-3c11ae9d-5713-4697-9496-877e428685bf service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-vif-unplugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Instance destroyed successfully.
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.objects.instance [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lazy-loading 'resources' on Instance uuid a9fcadc7-b19f-43c9-8934-5ef69396348d {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-461364657',display_name='tempest-VolumesSnapshotTestJSON-instance-461364657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-461364657',id=49,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1NniT8VCfqzSNutnIgpKWQPKx/351L01wN8n0a0kyExjFjMrBOCbhIuX7qKlYUs7dB2CDdz72W92sHIO+1eS8df9G79hNJ/NLe7O07kRpDTF3gshBiaR1t+N6/UXXKDQ==',key_name='tempest-keypair-1485353283',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:36:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6e76b8a1d6f4df4ad01e87a8bcf1e5d',ramdisk_id='',reservation_id='r-d0sdl3uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-880704583',owner_user_name='tempest-VolumesSnapshotTestJSON-880704583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:36:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73896b6e82ec4503b7ade30ad9174619',uuid=a9fcadc7-b19f-43c9-8934-5ef69396348d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converting VIF {"id": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "address": "fa:16:3e:f3:9c:db", "network": {"id": "daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2009012263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e76b8a1d6f4df4ad01e87a8bcf1e5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdafe4984-ee", "ovs_interfaceid": "dafe4984-eec2-43d2-b2f0-9ec6cf50a316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:9c:db,bridge_name='br-int',has_traffic_filtering=True,id=dafe4984-eec2-43d2-b2f0-9ec6cf50a316,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdafe4984-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG os_vif [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:9c:db,bridge_name='br-int',has_traffic_filtering=True,id=dafe4984-eec2-43d2-b2f0-9ec6cf50a316,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdafe4984-ee') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdafe4984-ee, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8458e639-57ca-418d-8a3b-1ca953f3b8fa) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:18 user nova-compute[75205]: INFO os_vif [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:9c:db,bridge_name='br-int',has_traffic_filtering=True,id=dafe4984-eec2-43d2-b2f0-9ec6cf50a316,network=Network(daf2a3b6-5e2b-4dfe-b257-4f2a5a2a8ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdafe4984-ee')
Nov 14 19:39:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTmfOJqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:39:18 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c09858c-63d6-449e-8b3b-f10bae7cdc7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:39:18 user nova-compute[75205]: No targets found.
Nov 14 19:39:18 user nova-compute[75205]: iSNS:
Nov 14 19:39:18 user nova-compute[75205]: No targets found.
Nov 14 19:39:18 user nova-compute[75205]: STATIC:
Nov 14 19:39:18 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1
Nov 14 19:39:18 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:39:18 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:39:18 user nova-compute[75205]: FIRMWARE:
Nov 14 19:39:18 user nova-compute[75205]: No targets found.
Nov 14 19:39:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:39:18 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:39:18 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e24ac4f5-f7b7-486c-ac2e-a8ed6fd67c0a', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b78b100-8586-4fb2-8087-efa731ee97c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c181f6a-3aad-430c-9ef9-4c1f59568c19]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:18 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb7410b880>, {}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Disconnecting from: [] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] <== disconnect_volume: return (93ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:39:18 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Deleting instance files /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d_del
Nov 14 19:39:18 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Deletion of /opt/stack/data/nova/instances/a9fcadc7-b19f-43c9-8934-5ef69396348d_del complete
Nov 14 19:39:18 user nova-compute[75205]: INFO nova.compute.manager [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 14 19:39:18 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:39:18 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:39:18 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Took 0.71 seconds to deallocate network for instance.
Nov 14 19:39:18 user nova-compute[75205]: WARNING nova.volume.cinder [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Attachment d2a4c75d-01f0-47fb-96e8-305ee74d4043 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d2a4c75d-01f0-47fb-96e8-305ee74d4043. (HTTP 404) (Request-ID: req-6f86d9f0-e908-465d-bd7a-a928d20118b0)
Nov 14 19:39:18 user nova-compute[75205]: INFO nova.compute.manager [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:19 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Deleted allocations for instance a9fcadc7-b19f-43c9-8934-5ef69396348d
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-ef99936b-fe98-4c49-a63c-57e9a3d0e0f6 tempest-VolumesSnapshotTestJSON-880704583 tempest-VolumesSnapshotTestJSON-880704583-project-member] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.271s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-e59e7e7e-d628-49d6-a0f3-18314e891242 req-2ba90a35-4105-4861-a4a7-c768cdc66739 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e59e7e7e-d628-49d6-a0f3-18314e891242 req-2ba90a35-4105-4861-a4a7-c768cdc66739 service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e59e7e7e-d628-49d6-a0f3-18314e891242 req-2ba90a35-4105-4861-a4a7-c768cdc66739 service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e59e7e7e-d628-49d6-a0f3-18314e891242 req-2ba90a35-4105-4861-a4a7-c768cdc66739 service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-e59e7e7e-d628-49d6-a0f3-18314e891242 req-2ba90a35-4105-4861-a4a7-c768cdc66739 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:39:19 user nova-compute[75205]: WARNING nova.compute.manager [req-e59e7e7e-d628-49d6-a0f3-18314e891242 req-2ba90a35-4105-4861-a4a7-c768cdc66739 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state building and task_state spawning.
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-e59e7e7e-d628-49d6-a0f3-18314e891242 req-2ba90a35-4105-4861-a4a7-c768cdc66739 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-vif-deleted-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] No waiting events found dispatching network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:39:19 user nova-compute[75205]: WARNING nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received unexpected event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 for instance with vm_state deleted and task_state None.
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] No waiting events found dispatching network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:39:19 user nova-compute[75205]: WARNING nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received unexpected event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 for instance with vm_state deleted and task_state None.
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] No waiting events found dispatching network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:39:19 user nova-compute[75205]: WARNING nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received unexpected event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 for instance with vm_state deleted and task_state None.
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-vif-unplugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] No waiting events found dispatching network-vif-unplugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:39:19 user nova-compute[75205]: WARNING nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received unexpected event network-vif-unplugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 for instance with vm_state deleted and task_state None.
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Acquiring lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] Lock "a9fcadc7-b19f-43c9-8934-5ef69396348d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] No waiting events found dispatching network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:39:19 user nova-compute[75205]: WARNING nova.compute.manager [req-0abead03-282f-4a27-99a8-68d8fa92cba3 req-84000210-a0d7-4e39-be81-860f5e9d5b82 service nova] [instance: a9fcadc7-b19f-43c9-8934-5ef69396348d] Received unexpected event network-vif-plugged-dafe4984-eec2-43d2-b2f0-9ec6cf50a316 for instance with vm_state deleted and task_state None.
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:39:19 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Instance spawned successfully.
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:39:19 user nova-compute[75205]: INFO nova.compute.manager [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 14 19:39:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:39:20 user nova-compute[75205]: INFO nova.compute.manager [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Took 6.91 seconds to build instance.
Nov 14 19:39:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-25eccdf5-1ae5-4366-bb32-e808bd23fe8c tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.005s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquired lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'info_cache' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.objects.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating instance_info_cache with network_info: [{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Releasing lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:39:25 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance destroyed successfully.
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'resources' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.objects.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-321592417',display_name='tempest-AttachVolumeTestJSON-server-321592417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-321592417',id=47,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwkYbMF2eFIKA42xW5vusjYSx4d8QgjUMIaP8oZNrds3UxZnMzXAOuFIsJqr7xOLlKmCiZ6+648aTqutgtELdkijulMWKFIOLQwHhmQ7THLE7FldU881gEvk+xJb0lcdg==',key_name='tempest-keypair-594362825',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-96r2n4ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=43121bd9-325e-4328-8d35-1448d2dd3d23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_vif [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap745822ef-b3, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=216fc1f4-12eb-418f-bd1d-4cb996591fe0) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:39:25 user nova-compute[75205]: INFO os_vif [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3')
Nov 14 19:39:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTFsPCrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:39:25 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c2b510-89d6-4bca-b719-9611b0cbdeb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:39:25 user nova-compute[75205]: No targets found.
Nov 14 19:39:25 user nova-compute[75205]: iSNS:
Nov 14 19:39:25 user nova-compute[75205]: No targets found.
Nov 14 19:39:25 user nova-compute[75205]: STATIC:
Nov 14 19:39:25 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1
Nov 14 19:39:25 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:39:25 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:39:25 user nova-compute[75205]: FIRMWARE:
Nov 14 19:39:25 user nova-compute[75205]: No targets found.
Nov 14 19:39:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:39:25 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:39:25 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c58be2e-31ab-40c7-b9a8-aeaa9326610a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba97c222-1fcb-4695-8d83-9239f938d15b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb741d1e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd6bbf5-f1d1-4468-ae86-165edacf3d58]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff95fb8-50d4-4aff-8855-049711fdbbad]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb94a6e-26dd-405f-981d-37e217eea905]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[686cb395-8b0c-492b-a052-abcf1b1ef3d2]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ec9bfd-33df-4512-ac44-56e60fefdf1a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6896387a-c430-4fc3-ac94-f2ad2fee5557]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260]
Nov 14 19:39:25 user nova-compute[75205]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260] successful.
Nov 14 19:39:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[90345086-57f5-4619-ab98-8b757d3e0d58]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== disconnect_volume: return (298ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Start _get_guest_xml network_info=[{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTFsPCrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '43121bd9-325e-4328-8d35-1448d2dd3d23', 'attached_at': '', 'detached_at': '', 'volume_id': '0e679453-a369-4c54-a519-4a9cfcac4da1', 'serial': '0e679453-a369-4c54-a519-4a9cfcac4da1'}, 'attachment_id': '7abd7af4-ec8c-4603-8f70-d0d67b09a6c0', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'numa_topology' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.objects.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:39:26 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:39:26 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.objects.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTFsPCrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:39:26 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:39:26 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:39:26 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f79e26-ef4f-43ba-90dc-69bd24b3b464]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:39:26 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a739af4-52ed-4174-9dd6-2bef443d6393]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1] added
Nov 14 19:39:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de51d94-2ac8-4b55-ad6a-0b1d6581f1bb]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83ebb89-edb9-44bd-b246-523f75dc0b32]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTFsPCrq {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTFsPCrq" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2151fe-78fe-4cd1-ab69-96d11007dce5]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hTFsPCrq'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5779f051-e79e-449a-b9bb-db31b67f4bcd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f2fdf-de56-42cf-835f-b5c18b8fd91b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:39:26 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:39:26 user nova-compute[75205]:  {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:39:26 user nova-compute[75205]: WARNING os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 19:39:26 user nova-compute[75205]: 
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[13955609-6c9c-4c38-8274-711215bde14a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260]
Nov 14 19:39:26 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260] successful.
Nov 14 19:39:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[18544757-d8c8-4757-adb2-ff47a3fc1cc1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da03a1-6274-48f0-9fd8-f5cc7e1f9649]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:26 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[811f049c-a014-44c3-b090-bfff06dce9a5]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:39:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTFsPCrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26134653037303838', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134653037303838', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-321592417',display_name='tempest-AttachVolumeTestJSON-server-321592417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-321592417',id=47,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwkYbMF2eFIKA42xW5vusjYSx4d8QgjUMIaP8oZNrds3UxZnMzXAOuFIsJqr7xOLlKmCiZ6+648aTqutgtELdkijulMWKFIOLQwHhmQ7THLE7FldU881gEvk+xJb0lcdg==',key_name='tempest-keypair-594362825',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-96r2n4ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=43121bd9-325e-4328-8d35-1448d2dd3d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'pci_devices' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG nova.objects.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:39:27 user nova-compute[75205]:   <uuid>43121bd9-325e-4328-8d35-1448d2dd3d23</uuid>
Nov 14 19:39:27 user nova-compute[75205]:   <name>instance-0000002f</name>
Nov 14 19:39:27 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:39:27 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:39:27 user nova-compute[75205]:   <metadata>
Nov 14 19:39:27 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:39:27 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:39:27 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeTestJSON-server-321592417</nova:name>
Nov 14 19:39:27 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:39:26</nova:creationTime>
Nov 14 19:39:27 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:39:27 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:39:27 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:39:27 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:39:27 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:39:27 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:39:27 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:39:27 user nova-compute[75205]:       <nova:owner>
Nov 14 19:39:27 user nova-compute[75205]:         <nova:user uuid="58202884478148cc892c360d7a2ee222">tempest-AttachVolumeTestJSON-282088086-project-member</nova:user>
Nov 14 19:39:27 user nova-compute[75205]:         <nova:project uuid="2a60993cb67d417194f8f9ef73e84550">tempest-AttachVolumeTestJSON-282088086</nova:project>
Nov 14 19:39:27 user nova-compute[75205]:       </nova:owner>
Nov 14 19:39:27 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:39:27 user nova-compute[75205]:       <nova:ports>
Nov 14 19:39:27 user nova-compute[75205]:         <nova:port uuid="745822ef-b300-4571-b0e6-392b770bb96c">
Nov 14 19:39:27 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 19:39:27 user nova-compute[75205]:         </nova:port>
Nov 14 19:39:27 user nova-compute[75205]:       </nova:ports>
Nov 14 19:39:27 user nova-compute[75205]:     </nova:instance>
Nov 14 19:39:27 user nova-compute[75205]:   </metadata>
Nov 14 19:39:27 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:39:27 user nova-compute[75205]:     <system>
Nov 14 19:39:27 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:39:27 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:39:27 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:39:27 user nova-compute[75205]:       <entry name="serial">43121bd9-325e-4328-8d35-1448d2dd3d23</entry>
Nov 14 19:39:27 user nova-compute[75205]:       <entry name="uuid">43121bd9-325e-4328-8d35-1448d2dd3d23</entry>
Nov 14 19:39:27 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:39:27 user nova-compute[75205]:     </system>
Nov 14 19:39:27 user nova-compute[75205]:   </sysinfo>
Nov 14 19:39:27 user nova-compute[75205]:   <os>
Nov 14 19:39:27 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:39:27 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:39:27 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:39:27 user nova-compute[75205]:   </os>
Nov 14 19:39:27 user nova-compute[75205]:   <features>
Nov 14 19:39:27 user nova-compute[75205]:     <acpi/>
Nov 14 19:39:27 user nova-compute[75205]:     <apic/>
Nov 14 19:39:27 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:39:27 user nova-compute[75205]:   </features>
Nov 14 19:39:27 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:39:27 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:39:27 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:39:27 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:39:27 user nova-compute[75205]:   </clock>
Nov 14 19:39:27 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:39:27 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:39:27 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:39:27 user nova-compute[75205]:   </cpu>
Nov 14 19:39:27 user nova-compute[75205]:   <devices>
Nov 14 19:39:27 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:39:27 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:39:27 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk"/>
Nov 14 19:39:27 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:39:27 user nova-compute[75205]:     </disk>
Nov 14 19:39:27 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:39:27 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:39:27 user nova-compute[75205]:       <source dev="/dev/sdb"/>
Nov 14 19:39:27 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:39:27 user nova-compute[75205]:       <serial>0e679453-a369-4c54-a519-4a9cfcac4da1</serial>
Nov 14 19:39:27 user nova-compute[75205]:     </disk>
Nov 14 19:39:27 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:39:27 user nova-compute[75205]:       <mac address="fa:16:3e:15:70:50"/>
Nov 14 19:39:27 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:39:27 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:39:27 user nova-compute[75205]:       <target dev="tap745822ef-b3"/>
Nov 14 19:39:27 user nova-compute[75205]:     </interface>
Nov 14 19:39:27 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:39:27 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/console.log" append="off"/>
Nov 14 19:39:27 user nova-compute[75205]:     </serial>
Nov 14 19:39:27 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:39:27 user nova-compute[75205]:     <video>
Nov 14 19:39:27 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:39:27 user nova-compute[75205]:     </video>
Nov 14 19:39:27 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:39:27 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:39:27 user nova-compute[75205]:     </rng>
Nov 14 19:39:27 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:39:27 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:39:27 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:39:27 user nova-compute[75205]:     </memballoon>
Nov 14 19:39:27 user nova-compute[75205]:   </devices>
Nov 14 19:39:27 user nova-compute[75205]: </domain>
Nov 14 19:39:27 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'trusted_certs' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG nova.objects.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:39:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Cannot resize image /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'migration_context' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG nova.objects.base [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-321592417',display_name='tempest-AttachVolumeTestJSON-server-321592417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-321592417',id=47,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwkYbMF2eFIKA42xW5vusjYSx4d8QgjUMIaP8oZNrds3UxZnMzXAOuFIsJqr7xOLlKmCiZ6+648aTqutgtELdkijulMWKFIOLQwHhmQ7THLE7FldU881gEvk+xJb0lcdg==',key_name='tempest-keypair-594362825',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-96r2n4ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=43121bd9-325e-4328-8d35-1448d2dd3d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG os_vif [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4af0f320-c38b-5109-9c79-5c42dceb2584', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap745822ef-b3, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap745822ef-b3, col_values=(('qos', UUID('9559f8ea-06ca-4151-a516-6a1c3f1c8ea8')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap745822ef-b3, col_values=(('external_ids', {'iface-id': '745822ef-b300-4571-b0e6-392b770bb96c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:70:50', 'vm-uuid': '43121bd9-325e-4328-8d35-1448d2dd3d23'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:39:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:28 user nova-compute[75205]: INFO os_vif [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3')
Nov 14 19:39:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-ee990bd3-3fdf-4c35-816c-a42fa6eeaefc req-a3aa9e6b-81a2-4b94-83fd-38016d22fbac service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ee990bd3-3fdf-4c35-816c-a42fa6eeaefc req-a3aa9e6b-81a2-4b94-83fd-38016d22fbac service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ee990bd3-3fdf-4c35-816c-a42fa6eeaefc req-a3aa9e6b-81a2-4b94-83fd-38016d22fbac service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-ee990bd3-3fdf-4c35-816c-a42fa6eeaefc req-a3aa9e6b-81a2-4b94-83fd-38016d22fbac service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:29 user nova-compute[75205]: DEBUG nova.compute.manager [req-ee990bd3-3fdf-4c35-816c-a42fa6eeaefc req-a3aa9e6b-81a2-4b94-83fd-38016d22fbac service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:39:29 user nova-compute[75205]: WARNING nova.compute.manager [req-ee990bd3-3fdf-4c35-816c-a42fa6eeaefc req-a3aa9e6b-81a2-4b94-83fd-38016d22fbac service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state stopped and task_state powering-on.
Nov 14 19:39:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:39:31 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance rebooted successfully.
Nov 14 19:39:31 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8590059c-e066-4100-ad5c-a1dd635019df tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:39:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-1a5a8ee9-da42-4c3b-8b95-7a63f540c64e req-092fd9dc-c6c8-4722-b343-a4027de51aa1 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:39:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1a5a8ee9-da42-4c3b-8b95-7a63f540c64e req-092fd9dc-c6c8-4722-b343-a4027de51aa1 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1a5a8ee9-da42-4c3b-8b95-7a63f540c64e req-092fd9dc-c6c8-4722-b343-a4027de51aa1 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:31 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1a5a8ee9-da42-4c3b-8b95-7a63f540c64e req-092fd9dc-c6c8-4722-b343-a4027de51aa1 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:31 user nova-compute[75205]: DEBUG nova.compute.manager [req-1a5a8ee9-da42-4c3b-8b95-7a63f540c64e req-092fd9dc-c6c8-4722-b343-a4027de51aa1 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:39:31 user nova-compute[75205]: WARNING nova.compute.manager [req-1a5a8ee9-da42-4c3b-8b95-7a63f540c64e req-092fd9dc-c6c8-4722-b343-a4027de51aa1 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state active and task_state None.
Nov 14 19:39:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG nova.objects.instance [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:40 user nova-compute[75205]: INFO nova.compute.manager [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attaching volume f6738714-1b8d-498e-83bf-805935568924 to /dev/vdb
Nov 14 19:39:40 user nova-compute[75205]: DEBUG os_brick.utils [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4d65ba-2d3c-4483-ac6d-1b4cdc610c84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f2ea58-ef84-4554-a82b-277741ed52fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.135s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d46e404-f49f-400b-a34d-91c1127f7732]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98b3c4c-3d2e-4cdd-9c00-07a0d448148c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:39:40 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:39:40 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69ee4c4-3bd2-4ade-96bc-4d72e30df85a]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG os_brick.utils [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== get_connector_properties: return (237ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:39:40 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating existing volume attachment record: ef13894f-a29f-4ea3-b939-d5ab7309e388 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:39:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqhwIyYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:39:44 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:39:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:39:44 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:39:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:39:44 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d796b4a0-d0bd-4e0b-b99f-f1e41db43e62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:39:44 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a289d42-e53d-478d-9e6d-81ebb0255ba7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924] added
Nov 14 19:39:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cef18c-aaac-4618-86c5-dd1b00e5b7f1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[286db995-7ec4-4a92-be47-002997db18ec]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MqhwIyYX {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MqhwIyYX" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[104b90e1-a30c-4618-8a25-9bd4e08f7211]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MqhwIyYX'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2255b11-f873-4386-b919-6451eba2a61d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce87628-49e4-4706-9938-7045c27d8262]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:45 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:45 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[df878c18-4d60-4e56-81a8-b7ccc7433ae3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924, portal: 172.16.0.220,3260]
Nov 14 19:39:45 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924, portal: 172.16.0.220,3260] successful.
Nov 14 19:39:45 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[679a8fbd-0bc3-4e65-8ba0-9be4b5edb53d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25b42e8-7b2b-412f-85d5-6d5246912049]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:45 user nova-compute[75205]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 (non-flash)
Nov 14 19:39:45 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:39:45 user nova-compute[75205]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 (non-flash)
Nov 14 19:39:45 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b739648-395f-4c5d-886e-3cb1b2e1c661]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqhwIyYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:39:45 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:39:46 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:39:46 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8425MB free_disk=24.995159149169922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26430303635656364', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430303635656364', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.objects.instance [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:39:46 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:39:46 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:39:46 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:39:46 user nova-compute[75205]:   <serial>f6738714-1b8d-498e-83bf-805935568924</serial>
Nov 14 19:39:46 user nova-compute[75205]: </disk>
Nov 14 19:39:46 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance f308e6dd-371b-466a-88d4-1d186fef55d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:39:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] No VIF found with MAC fa:16:3e:8c:ac:75, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:39:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-d3e8343c-f6b0-4394-aeec-67b6bdb37b65 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.714s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:39:47 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:47 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:39:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:39:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:39:49 user nova-compute[75205]: INFO nova.compute.manager [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Detaching volume f6738714-1b8d-498e-83bf-805935568924
Nov 14 19:39:49 user nova-compute[75205]: INFO nova.virt.block_device [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Attempting to driver detach volume f6738714-1b8d-498e-83bf-805935568924 from mountpoint /dev/vdb
Nov 14 19:39:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Attempting to detach device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:39:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:39:49 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:39:49 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:39:49 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:39:49 user nova-compute[75205]:   <serial>f6738714-1b8d-498e-83bf-805935568924</serial>
Nov 14 19:39:49 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:39:49 user nova-compute[75205]: </disk>
Nov 14 19:39:49 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:39:49 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Successfully detached device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the persistent domain config.
Nov 14 19:39:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:39:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:39:49 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:39:49 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:39:49 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:39:49 user nova-compute[75205]:   <serial>f6738714-1b8d-498e-83bf-805935568924</serial>
Nov 14 19:39:49 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:39:49 user nova-compute[75205]: </disk>
Nov 14 19:39:49 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:39:49 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating instance_info_cache with network_info: [{"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-f308e6dd-371b-466a-88d4-1d186fef55d3" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:39:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:39:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:53 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:57 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:39:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:39:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75205) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 19:40:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:40:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 19:40:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] There are 0 instances to clean {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 19:40:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:09 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f308e6dd-371b-466a-88d4-1d186fef55d3 is timed out.
Nov 14 19:40:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Successfully detached device vdb from instance f308e6dd-371b-466a-88d4-1d186fef55d3 from the live domain config.
Nov 14 19:40:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqhwIyYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:40:09 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5af179-6026-4882-a3d7-c78ebaae5fe9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:40:09 user nova-compute[75205]: No targets found.
Nov 14 19:40:09 user nova-compute[75205]: iSNS:
Nov 14 19:40:09 user nova-compute[75205]: No targets found.
Nov 14 19:40:09 user nova-compute[75205]: STATIC:
Nov 14 19:40:09 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924
Nov 14 19:40:09 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:40:09 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:40:09 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1
Nov 14 19:40:09 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:40:09 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:40:09 user nova-compute[75205]: FIRMWARE:
Nov 14 19:40:09 user nova-compute[75205]: No targets found.
Nov 14 19:40:09 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:40:09 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:40:09 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac01125-5f9e-48ee-8fdc-82d3eca957fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20a8536-d5af-4fb8-b0c1-8c2660611b3c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:40:09 user nova-compute[75205]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 (non-flash)
Nov 14 19:40:09 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:40:09 user nova-compute[75205]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 (non-flash)
Nov 14 19:40:09 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb741455a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f0b971-dc80-40e1-ad05-ee0bb6cfc95b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[84126a69-ce05-43e7-b16d-d28ba963325e]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:40:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4f20a8-e4a1-4d8a-8f34-8d3d3c4c6c23]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f39c3-7884-401c-a3b3-8337b61fd668]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd37c1-9d96-45b9-8a59-1eb23aaa2bfd]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd975e-c600-45c6-9d67-1dcf9e93b365]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924, portal: 172.16.0.220,3260]
Nov 14 19:40:10 user nova-compute[75205]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924, portal: 172.16.0.220,3260] successful.
Nov 14 19:40:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6738714-1b8d-498e-83bf-805935568924 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ffecba-7ffb-4eff-ae46-5b36acddfa9e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] <== disconnect_volume: return (288ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG nova.objects.instance [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'flavor' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:40:10 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-2f606f5e-407e-4239-a698-c5c76ae9c38c tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:40:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:40:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:40:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:40:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:40:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:40:48 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:40:48 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=24.984848022460938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance f308e6dd-371b-466a-88d4-1d186fef55d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing inventories for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Updating ProviderTree inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing aggregate associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, aggregates: None {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing trait associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, traits: HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:40:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:40:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:40:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:40:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:40:52 user nova-compute[75205]: INFO nova.compute.manager [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Terminating instance
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.compute.manager [req-40decb72-493a-4389-b1fd-68946f5c1a60 req-414b660c-e9cc-4211-b43c-81cceb8cdd91 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received event network-vif-unplugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-40decb72-493a-4389-b1fd-68946f5c1a60 req-414b660c-e9cc-4211-b43c-81cceb8cdd91 service nova] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-40decb72-493a-4389-b1fd-68946f5c1a60 req-414b660c-e9cc-4211-b43c-81cceb8cdd91 service nova] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-40decb72-493a-4389-b1fd-68946f5c1a60 req-414b660c-e9cc-4211-b43c-81cceb8cdd91 service nova] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.compute.manager [req-40decb72-493a-4389-b1fd-68946f5c1a60 req-414b660c-e9cc-4211-b43c-81cceb8cdd91 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] No waiting events found dispatching network-vif-unplugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.compute.manager [req-40decb72-493a-4389-b1fd-68946f5c1a60 req-414b660c-e9cc-4211-b43c-81cceb8cdd91 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received event network-vif-unplugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:40:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Instance destroyed successfully.
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lazy-loading 'resources' on Instance uuid f308e6dd-371b-466a-88d4-1d186fef55d3 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:34:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1264497628',display_name='tempest-SnapshotDataIntegrityTests-server-1264497628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1264497628',id=46,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHK/N2x2dV5wpn3MqzUEd3aZ7sqIzeURLEsp3xqlM//iWAyOLOJMHPOtrxcS8j21X9WTAKY9x6t4uBdebhnG8lwA5gduTBJhnVnwVFK7P+0ndTHXI6fHGeh8x2ZzbsOnfA==',key_name='tempest-keypair-54726157',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99733ea8356b43c3adda0df55c4d83fa',ramdisk_id='',reservation_id='r-bsg0ivjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1349380683',owner_user_name='tempest-SnapshotDataIntegrityTests-1349380683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:34:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47e6f274df2942cca10a45372cc3fab4',uuid=f308e6dd-371b-466a-88d4-1d186fef55d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Converting VIF {"id": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "address": "fa:16:3e:8c:ac:75", "network": {"id": "c16b7124-e118-43f9-9cc8-baf4eda9ec31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-127800168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99733ea8356b43c3adda0df55c4d83fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a33d1ba-17", "ovs_interfaceid": "6a33d1ba-174c-4dc6-9b82-76c07db2aa28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ac:75,bridge_name='br-int',has_traffic_filtering=True,id=6a33d1ba-174c-4dc6-9b82-76c07db2aa28,network=Network(c16b7124-e118-43f9-9cc8-baf4eda9ec31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a33d1ba-17') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG os_vif [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ac:75,bridge_name='br-int',has_traffic_filtering=True,id=6a33d1ba-174c-4dc6-9b82-76c07db2aa28,network=Network(c16b7124-e118-43f9-9cc8-baf4eda9ec31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a33d1ba-17') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a33d1ba-17, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea0d089d-86d1-491b-a80a-c2ab703c09e7) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:40:52 user nova-compute[75205]: INFO os_vif [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ac:75,bridge_name='br-int',has_traffic_filtering=True,id=6a33d1ba-174c-4dc6-9b82-76c07db2aa28,network=Network(c16b7124-e118-43f9-9cc8-baf4eda9ec31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a33d1ba-17')
Nov 14 19:40:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Deleting instance files /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3_del
Nov 14 19:40:52 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Deletion of /opt/stack/data/nova/instances/f308e6dd-371b-466a-88d4-1d186fef55d3_del complete
Nov 14 19:40:52 user nova-compute[75205]: INFO nova.compute.manager [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 19:40:52 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:40:52 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:40:53 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating instance_info_cache with network_info: [{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:40:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:40:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:40:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:40:53 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:40:53 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Took 0.82 seconds to deallocate network for instance.
Nov 14 19:40:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:40:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:40:53 user nova-compute[75205]: DEBUG nova.compute.manager [req-ba65d4b8-0945-4940-9bc9-18e9a0ace148 req-e70fef3b-210c-4dbf-b815-2832e5b273c4 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received event network-vif-deleted-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:40:53 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:40:53 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:40:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:40:54 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Deleted allocations for instance f308e6dd-371b-466a-88d4-1d186fef55d3
Nov 14 19:40:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5f7c401d-b024-4966-ad82-aad54f9b1601 tempest-SnapshotDataIntegrityTests-1349380683 tempest-SnapshotDataIntegrityTests-1349380683-project-member] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.004s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:40:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:40:54 user nova-compute[75205]: DEBUG nova.compute.manager [req-0d1ef98e-1e87-40cb-ad3d-a1911afc284e req-8e9e986c-85ab-49a4-bf20-ce15592e9708 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received event network-vif-plugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:40:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0d1ef98e-1e87-40cb-ad3d-a1911afc284e req-8e9e986c-85ab-49a4-bf20-ce15592e9708 service nova] Acquiring lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:40:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0d1ef98e-1e87-40cb-ad3d-a1911afc284e req-8e9e986c-85ab-49a4-bf20-ce15592e9708 service nova] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:40:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0d1ef98e-1e87-40cb-ad3d-a1911afc284e req-8e9e986c-85ab-49a4-bf20-ce15592e9708 service nova] Lock "f308e6dd-371b-466a-88d4-1d186fef55d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:40:54 user nova-compute[75205]: DEBUG nova.compute.manager [req-0d1ef98e-1e87-40cb-ad3d-a1911afc284e req-8e9e986c-85ab-49a4-bf20-ce15592e9708 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] No waiting events found dispatching network-vif-plugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:40:54 user nova-compute[75205]: WARNING nova.compute.manager [req-0d1ef98e-1e87-40cb-ad3d-a1911afc284e req-8e9e986c-85ab-49a4-bf20-ce15592e9708 service nova] [instance: f308e6dd-371b-466a-88d4-1d186fef55d3] Received unexpected event network-vif-plugged-6a33d1ba-174c-4dc6-9b82-76c07db2aa28 for instance with vm_state deleted and task_state None.
Nov 14 19:40:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:40:56 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:40:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:41:04 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'flavor' on Instance uuid 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:05 user nova-compute[75205]: INFO nova.compute.manager [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Attaching volume 0fe23f61-de24-4038-b1fb-919d4a6c25b6 to /dev/vdb
Nov 14 19:41:05 user nova-compute[75205]: DEBUG os_brick.utils [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[717125c6-4c21-4f54-80dc-9c8e512c12bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c55c2ab-05e8-4b6d-943e-29d74063a879]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[17212964-74b8-40cd-be01-725575337b44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1460b71a-776a-4d99-9bc4-3cebaa1689c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:41:05 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:41:05 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b67e3b-7cdf-41c0-aa20-b598ce2af9fb]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG os_brick.utils [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:41:05 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating existing volume attachment record: b20996c8-89c6-4241-b80d-c34389b56fab {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:41:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiDJOIUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:41:09 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:41:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:41:09 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:41:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:41:09 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:41:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f635bed-f2c0-4f2c-ba0c-6752c8c4f6ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:41:09 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[71006b1e-f737-4b11-9521-3a971ddef7bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6] added
Nov 14 19:41:09 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:09 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f91cf26-54ca-47b3-ad9b-9bfdb09f46c8]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[54084980-6ad7-4cdd-9ac2-0f1ef2321abe]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiDJOIUc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiDJOIUc" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dbbf72-bd89-4fb3-a244-9ff7bbdfeab3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CiDJOIUc'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8491ed-4853-46bf-bdea-ab460f57cb4b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[56db5ac9-2f46-41da-ad21-b71804f73833]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe83787-196b-4f5b-bd6e-d6eb6c632a1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260]
Nov 14 19:41:10 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260] successful.
Nov 14 19:41:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[19737e88-1dd5-4034-b23a-2a69ae165472]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a3012d-84cb-4a64-8a7c-3d625ded2117]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:10 user nova-compute[75205]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)
Nov 14 19:41:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:10 user nova-compute[75205]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)
Nov 14 19:41:10 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d2621-7b13-46b8-ac21-3015ff9d6276]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:41:10 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiDJOIUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:41:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:41:11 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26532653739363433', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:41:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532653739363433', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:41:11 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'flavor' on Instance uuid 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:41:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:41:11 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:41:11 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:41:11 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:41:11 user nova-compute[75205]:   <serial>0fe23f61-de24-4038-b1fb-919d4a6c25b6</serial>
Nov 14 19:41:11 user nova-compute[75205]: </disk>
Nov 14 19:41:11 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:41:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:41:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:41:11 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] No VIF found with MAC fa:16:3e:70:39:e6, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:41:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f7f07dc9-129a-4ffa-b4fd-2e7e9f1e0db3 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.204s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:15 user nova-compute[75205]: DEBUG nova.compute.manager [req-0cb5c1b6-f5c1-4c8c-b7e2-7a58b4536b57 req-c73ed662-5410-4958-8928-ba1a558c718e service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-changed-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:41:15 user nova-compute[75205]: DEBUG nova.compute.manager [req-0cb5c1b6-f5c1-4c8c-b7e2-7a58b4536b57 req-c73ed662-5410-4958-8928-ba1a558c718e service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Refreshing instance network info cache due to event network-changed-96fe9173-4e8b-435c-abc7-58a88afe1e39. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:41:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0cb5c1b6-f5c1-4c8c-b7e2-7a58b4536b57 req-c73ed662-5410-4958-8928-ba1a558c718e service nova] Acquiring lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:41:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0cb5c1b6-f5c1-4c8c-b7e2-7a58b4536b57 req-c73ed662-5410-4958-8928-ba1a558c718e service nova] Acquired lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:41:15 user nova-compute[75205]: DEBUG nova.network.neutron [req-0cb5c1b6-f5c1-4c8c-b7e2-7a58b4536b57 req-c73ed662-5410-4958-8928-ba1a558c718e service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Refreshing network info cache for port 96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:41:15 user nova-compute[75205]: DEBUG nova.network.neutron [req-0cb5c1b6-f5c1-4c8c-b7e2-7a58b4536b57 req-c73ed662-5410-4958-8928-ba1a558c718e service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updated VIF entry in instance network info cache for port 96fe9173-4e8b-435c-abc7-58a88afe1e39. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:41:15 user nova-compute[75205]: DEBUG nova.network.neutron [req-0cb5c1b6-f5c1-4c8c-b7e2-7a58b4536b57 req-c73ed662-5410-4958-8928-ba1a558c718e service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:41:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-0cb5c1b6-f5c1-4c8c-b7e2-7a58b4536b57 req-c73ed662-5410-4958-8928-ba1a558c718e service nova] Releasing lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:41:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:16 user nova-compute[75205]: INFO nova.compute.manager [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Detaching volume 0e679453-a369-4c54-a519-4a9cfcac4da1
Nov 14 19:41:16 user nova-compute[75205]: INFO nova.virt.block_device [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Attempting to driver detach volume 0e679453-a369-4c54-a519-4a9cfcac4da1 from mountpoint /dev/vdb
Nov 14 19:41:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Attempting to detach device vdb from instance 43121bd9-325e-4328-8d35-1448d2dd3d23 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:41:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:41:16 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:41:16 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:41:16 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:41:16 user nova-compute[75205]:   <serial>0e679453-a369-4c54-a519-4a9cfcac4da1</serial>
Nov 14 19:41:16 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 19:41:16 user nova-compute[75205]: </disk>
Nov 14 19:41:16 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:41:16 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully detached device vdb from instance 43121bd9-325e-4328-8d35-1448d2dd3d23 from the persistent domain config.
Nov 14 19:41:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43121bd9-325e-4328-8d35-1448d2dd3d23 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:41:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:41:16 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:41:16 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:41:16 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:41:16 user nova-compute[75205]:   <serial>0e679453-a369-4c54-a519-4a9cfcac4da1</serial>
Nov 14 19:41:16 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 19:41:16 user nova-compute[75205]: </disk>
Nov 14 19:41:16 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:41:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:41:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-16938e5a-44d1-4ad5-8b49-0a25770db8a7 req-f00eba26-9278-48de-aaea-1488a6f65698 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-changed-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:41:17 user nova-compute[75205]: DEBUG nova.compute.manager [req-16938e5a-44d1-4ad5-8b49-0a25770db8a7 req-f00eba26-9278-48de-aaea-1488a6f65698 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Refreshing instance network info cache due to event network-changed-96fe9173-4e8b-435c-abc7-58a88afe1e39. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:41:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-16938e5a-44d1-4ad5-8b49-0a25770db8a7 req-f00eba26-9278-48de-aaea-1488a6f65698 service nova] Acquiring lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:41:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-16938e5a-44d1-4ad5-8b49-0a25770db8a7 req-f00eba26-9278-48de-aaea-1488a6f65698 service nova] Acquired lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:41:17 user nova-compute[75205]: DEBUG nova.network.neutron [req-16938e5a-44d1-4ad5-8b49-0a25770db8a7 req-f00eba26-9278-48de-aaea-1488a6f65698 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Refreshing network info cache for port 96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:41:17 user nova-compute[75205]: DEBUG nova.network.neutron [req-16938e5a-44d1-4ad5-8b49-0a25770db8a7 req-f00eba26-9278-48de-aaea-1488a6f65698 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updated VIF entry in instance network info cache for port 96fe9173-4e8b-435c-abc7-58a88afe1e39. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:41:17 user nova-compute[75205]: DEBUG nova.network.neutron [req-16938e5a-44d1-4ad5-8b49-0a25770db8a7 req-f00eba26-9278-48de-aaea-1488a6f65698 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:41:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:17 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-16938e5a-44d1-4ad5-8b49-0a25770db8a7 req-f00eba26-9278-48de-aaea-1488a6f65698 service nova] Releasing lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:41:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:19 user nova-compute[75205]: INFO nova.compute.manager [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Rebooting instance
Nov 14 19:41:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquired lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG nova.network.neutron [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Releasing lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-9793baed-2473-4a5f-b5d2-9a4e690acf5a req-23686422-ba7d-4f1b-b48d-20fe047a83de service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-unplugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9793baed-2473-4a5f-b5d2-9a4e690acf5a req-23686422-ba7d-4f1b-b48d-20fe047a83de service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9793baed-2473-4a5f-b5d2-9a4e690acf5a req-23686422-ba7d-4f1b-b48d-20fe047a83de service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-9793baed-2473-4a5f-b5d2-9a4e690acf5a req-23686422-ba7d-4f1b-b48d-20fe047a83de service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:19 user nova-compute[75205]: DEBUG nova.compute.manager [req-9793baed-2473-4a5f-b5d2-9a4e690acf5a req-23686422-ba7d-4f1b-b48d-20fe047a83de service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-unplugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:41:19 user nova-compute[75205]: WARNING nova.compute.manager [req-9793baed-2473-4a5f-b5d2-9a4e690acf5a req-23686422-ba7d-4f1b-b48d-20fe047a83de service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-unplugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 19:41:20 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Instance destroyed successfully.
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'resources' on Instance uuid 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-659509003',display_name='tempest-TestMinimumBasicScenario-server-659509003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-659509003',id=50,image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoRxAXyyRyvp4ISDz44uTTzcyrFRN+Y/Y6dglFi6JGQNUuyn0u6gRZz/CVA0g0KRYfKYzktzAwrrjSC37i4fwtYzQQQ6rSDkDkgIucLmh36ObtAppZg7HW21KcMeNUJSA==',key_name='tempest-TestMinimumBasicScenario-1815893540',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d749beb4f34d2fafa10b4a3cdbab88',ramdisk_id='',reservation_id='r-o6g8z44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-400789003',owner_user_name='tempest-TestMinimumBasicScenario-400789003-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:41:20Z,user_data=None,user_id='949d766f59384494943cb27d5bbc3b95',uuid=3b69180c-5fb5-43b8-92ea-1cce7b036da9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converting VIF {"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_vif [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96fe9173-4e, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79e89aa8-6fde-4b34-b611-a31a8014a0b6) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:41:20 user nova-compute[75205]: INFO os_vif [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e')
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiDJOIUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:41:20 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ee2ca-6187-49e3-a775-fa67416bb625]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:41:20 user nova-compute[75205]: No targets found.
Nov 14 19:41:20 user nova-compute[75205]: iSNS:
Nov 14 19:41:20 user nova-compute[75205]: No targets found.
Nov 14 19:41:20 user nova-compute[75205]: STATIC:
Nov 14 19:41:20 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1
Nov 14 19:41:20 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:41:20 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:41:20 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6
Nov 14 19:41:20 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:41:20 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:41:20 user nova-compute[75205]: FIRMWARE:
Nov 14 19:41:20 user nova-compute[75205]: No targets found.
Nov 14 19:41:20 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:41:20 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:41:20 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[91094d33-73ed-4984-a37f-19f547dabfec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa312b5-1007-4a37-9e6f-4a564895776a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:20 user nova-compute[75205]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)
Nov 14 19:41:20 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:20 user nova-compute[75205]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)
Nov 14 19:41:20 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c3a7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1837633-911d-4b08-a8e9-96a9b8e37858]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a954f277-f078-4cdf-9af6-a4756075e77f]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[93454011-71a2-4bc7-8473-eb1a16cea99b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a0e6fe-16a8-4c80-8fc4-d12363d483cd]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4481977d-4cd2-45f5-8998-88a41bc777e4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d29a3fc-c2f9-4a91-b146-9dc33daf73cd]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260]
Nov 14 19:41:20 user nova-compute[75205]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260] successful.
Nov 14 19:41:20 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dbf66a-fa65-40f7-8e7b-bdf2a0dde09a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] <== disconnect_volume: return (299ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Start _get_guest_xml network_info=[{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=73c45d86-1d4b-4749-ba39-4186e7c098f8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '73c45d86-1d4b-4749-ba39-4186e7c098f8'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiDJOIUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3b69180c-5fb5-43b8-92ea-1cce7b036da9', 'attached_at': '', 'detached_at': '', 'volume_id': '0fe23f61-de24-4038-b1fb-919d4a6c25b6', 'serial': '0fe23f61-de24-4038-b1fb-919d4a6c25b6'}, 'attachment_id': 'b20996c8-89c6-4241-b80d-c34389b56fab', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:41:20 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:41:20 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=73c45d86-1d4b-4749-ba39-4186e7c098f8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.objects.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Object Instance<3b69180c-5fb5-43b8-92ea-1cce7b036da9> lazy-loaded attributes: resources,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiDJOIUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:41:20 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:41:20 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:41:20 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8965a4-1777-451a-97da-40ae4877b674]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:41:20 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc446a19-4d26-4963-9971-e3d7f3101fc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6] added
Nov 14 19:41:20 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f291832-d1cd-45d6-b6d7-b35a91c31e3e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccbe158-4d18-4d07-ab85-4c4c6ba8311e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:20 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiDJOIUc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiDJOIUc" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c592b3-4115-4877-a1b7-07a32bfc66e3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CiDJOIUc'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[844dce8a-fcd2-44d5-8686-b7753b17cc94]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[99451a10-3c81-4465-b820-701f990243ef]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47e2829-ed16-491a-a9e6-a329759e7a29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260]
Nov 14 19:41:21 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260] successful.
Nov 14 19:41:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[006b9ebb-91b1-41b3-9694-6bfdac473d2a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9efa2c6-d5d2-4774-bc8f-d1224d952e07]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:21 user nova-compute[75205]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)
Nov 14 19:41:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:21 user nova-compute[75205]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)
Nov 14 19:41:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafa1302-3ca4-40c2-8a3a-d4cb7fb72102]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:41:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiDJOIUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-de55f1d5-c6f1-42b7-a2b3-298419fda265 req-c5f01539-6197-49cf-8d3e-1e53b38d7709 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-de55f1d5-c6f1-42b7-a2b3-298419fda265 req-c5f01539-6197-49cf-8d3e-1e53b38d7709 service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-de55f1d5-c6f1-42b7-a2b3-298419fda265 req-c5f01539-6197-49cf-8d3e-1e53b38d7709 service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-de55f1d5-c6f1-42b7-a2b3-298419fda265 req-c5f01539-6197-49cf-8d3e-1e53b38d7709 service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-de55f1d5-c6f1-42b7-a2b3-298419fda265 req-c5f01539-6197-49cf-8d3e-1e53b38d7709 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:41:22 user nova-compute[75205]: WARNING nova.compute.manager [req-de55f1d5-c6f1-42b7-a2b3-298419fda265 req-c5f01539-6197-49cf-8d3e-1e53b38d7709 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 19:41:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26532653739363433', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532653739363433', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-659509003',display_name='tempest-TestMinimumBasicScenario-server-659509003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-659509003',id=50,image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoRxAXyyRyvp4ISDz44uTTzcyrFRN+Y/Y6dglFi6JGQNUuyn0u6gRZz/CVA0g0KRYfKYzktzAwrrjSC37i4fwtYzQQQ6rSDkDkgIucLmh36ObtAppZg7HW21KcMeNUJSA==',key_name='tempest-TestMinimumBasicScenario-1815893540',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d749beb4f34d2fafa10b4a3cdbab88',ramdisk_id='',reservation_id='r-o6g8z44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-400789003',owner_user_name='tempest-TestMinimumBasicScenario-400789003-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:41:20Z,user_data=None,user_id='949d766f59384494943cb27d5bbc3b95',uuid=3b69180c-5fb5-43b8-92ea-1cce7b036da9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converting VIF {"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.objects.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Object Instance<3b69180c-5fb5-43b8-92ea-1cce7b036da9> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:41:22 user nova-compute[75205]:   <uuid>3b69180c-5fb5-43b8-92ea-1cce7b036da9</uuid>
Nov 14 19:41:22 user nova-compute[75205]:   <name>instance-00000032</name>
Nov 14 19:41:22 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:41:22 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:41:22 user nova-compute[75205]:   <metadata>
Nov 14 19:41:22 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:41:22 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:41:22 user nova-compute[75205]:       <nova:name>tempest-TestMinimumBasicScenario-server-659509003</nova:name>
Nov 14 19:41:22 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:41:20</nova:creationTime>
Nov 14 19:41:22 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:41:22 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:41:22 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:41:22 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:41:22 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:41:22 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:41:22 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:41:22 user nova-compute[75205]:       <nova:owner>
Nov 14 19:41:22 user nova-compute[75205]:         <nova:user uuid="949d766f59384494943cb27d5bbc3b95">tempest-TestMinimumBasicScenario-400789003-project-member</nova:user>
Nov 14 19:41:22 user nova-compute[75205]:         <nova:project uuid="32d749beb4f34d2fafa10b4a3cdbab88">tempest-TestMinimumBasicScenario-400789003</nova:project>
Nov 14 19:41:22 user nova-compute[75205]:       </nova:owner>
Nov 14 19:41:22 user nova-compute[75205]:       <nova:root type="image" uuid="73c45d86-1d4b-4749-ba39-4186e7c098f8"/>
Nov 14 19:41:22 user nova-compute[75205]:       <nova:ports>
Nov 14 19:41:22 user nova-compute[75205]:         <nova:port uuid="96fe9173-4e8b-435c-abc7-58a88afe1e39">
Nov 14 19:41:22 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 19:41:22 user nova-compute[75205]:         </nova:port>
Nov 14 19:41:22 user nova-compute[75205]:       </nova:ports>
Nov 14 19:41:22 user nova-compute[75205]:     </nova:instance>
Nov 14 19:41:22 user nova-compute[75205]:   </metadata>
Nov 14 19:41:22 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:41:22 user nova-compute[75205]:     <system>
Nov 14 19:41:22 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:41:22 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:41:22 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:41:22 user nova-compute[75205]:       <entry name="serial">3b69180c-5fb5-43b8-92ea-1cce7b036da9</entry>
Nov 14 19:41:22 user nova-compute[75205]:       <entry name="uuid">3b69180c-5fb5-43b8-92ea-1cce7b036da9</entry>
Nov 14 19:41:22 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:41:22 user nova-compute[75205]:     </system>
Nov 14 19:41:22 user nova-compute[75205]:   </sysinfo>
Nov 14 19:41:22 user nova-compute[75205]:   <os>
Nov 14 19:41:22 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:41:22 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:41:22 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:41:22 user nova-compute[75205]:   </os>
Nov 14 19:41:22 user nova-compute[75205]:   <features>
Nov 14 19:41:22 user nova-compute[75205]:     <acpi/>
Nov 14 19:41:22 user nova-compute[75205]:     <apic/>
Nov 14 19:41:22 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:41:22 user nova-compute[75205]:   </features>
Nov 14 19:41:22 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:41:22 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:41:22 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:41:22 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:41:22 user nova-compute[75205]:   </clock>
Nov 14 19:41:22 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:41:22 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:41:22 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:41:22 user nova-compute[75205]:   </cpu>
Nov 14 19:41:22 user nova-compute[75205]:   <devices>
Nov 14 19:41:22 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:41:22 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:41:22 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk"/>
Nov 14 19:41:22 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:41:22 user nova-compute[75205]:     </disk>
Nov 14 19:41:22 user nova-compute[75205]:     <disk type="block" device="disk">
Nov 14 19:41:22 user nova-compute[75205]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:41:22 user nova-compute[75205]:       <source dev="/dev/sdc"/>
Nov 14 19:41:22 user nova-compute[75205]:       <target dev="vdb" bus="virtio"/>
Nov 14 19:41:22 user nova-compute[75205]:       <serial>0fe23f61-de24-4038-b1fb-919d4a6c25b6</serial>
Nov 14 19:41:22 user nova-compute[75205]:     </disk>
Nov 14 19:41:22 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:41:22 user nova-compute[75205]:       <mac address="fa:16:3e:70:39:e6"/>
Nov 14 19:41:22 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:41:22 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:41:22 user nova-compute[75205]:       <target dev="tap96fe9173-4e"/>
Nov 14 19:41:22 user nova-compute[75205]:     </interface>
Nov 14 19:41:22 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:41:22 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/console.log" append="off"/>
Nov 14 19:41:22 user nova-compute[75205]:     </serial>
Nov 14 19:41:22 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:41:22 user nova-compute[75205]:     <video>
Nov 14 19:41:22 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:41:22 user nova-compute[75205]:     </video>
Nov 14 19:41:22 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:41:22 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:41:22 user nova-compute[75205]:     </rng>
Nov 14 19:41:22 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:41:22 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:41:22 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:41:22 user nova-compute[75205]:     </memballoon>
Nov 14 19:41:22 user nova-compute[75205]:   </devices>
Nov 14 19:41:22 user nova-compute[75205]: </domain>
Nov 14 19:41:22 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.objects.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Object Instance<3b69180c-5fb5-43b8-92ea-1cce7b036da9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Cannot resize image /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'migration_context' on Instance uuid 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:41:22 user nova-compute[75205]: DEBUG nova.objects.base [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Object Instance<3b69180c-5fb5-43b8-92ea-1cce7b036da9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-659509003',display_name='tempest-TestMinimumBasicScenario-server-659509003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-659509003',id=50,image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoRxAXyyRyvp4ISDz44uTTzcyrFRN+Y/Y6dglFi6JGQNUuyn0u6gRZz/CVA0g0KRYfKYzktzAwrrjSC37i4fwtYzQQQ6rSDkDkgIucLmh36ObtAppZg7HW21KcMeNUJSA==',key_name='tempest-TestMinimumBasicScenario-1815893540',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='32d749beb4f34d2fafa10b4a3cdbab88',ramdisk_id='',reservation_id='r-o6g8z44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-400789003',owner_user_name='tempest-TestMinimumBasicScenario-400789003-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:41:20Z,user_data=None,user_id='949d766f59384494943cb27d5bbc3b95',uuid=3b69180c-5fb5-43b8-92ea-1cce7b036da9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converting VIF {"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG os_vif [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3504a7c4-9a77-5e14-ae27-138de02f2d40', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96fe9173-4e, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96fe9173-4e, col_values=(('qos', UUID('f1e87b42-1d5a-45f0-b36d-273fb02916e6')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96fe9173-4e, col_values=(('external_ids', {'iface-id': '96fe9173-4e8b-435c-abc7-58a88afe1e39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:39:e6', 'vm-uuid': '3b69180c-5fb5-43b8-92ea-1cce7b036da9'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:41:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:23 user nova-compute[75205]: INFO os_vif [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e')
Nov 14 19:41:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:24 user nova-compute[75205]: DEBUG nova.compute.manager [req-1d8eccca-a0db-43e1-9b46-a52795c787da req-02ed1c48-c241-485b-a786-6d54aeb657a8 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:41:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1d8eccca-a0db-43e1-9b46-a52795c787da req-02ed1c48-c241-485b-a786-6d54aeb657a8 service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1d8eccca-a0db-43e1-9b46-a52795c787da req-02ed1c48-c241-485b-a786-6d54aeb657a8 service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:24 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-1d8eccca-a0db-43e1-9b46-a52795c787da req-02ed1c48-c241-485b-a786-6d54aeb657a8 service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:24 user nova-compute[75205]: DEBUG nova.compute.manager [req-1d8eccca-a0db-43e1-9b46-a52795c787da req-02ed1c48-c241-485b-a786-6d54aeb657a8 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:41:24 user nova-compute[75205]: WARNING nova.compute.manager [req-1d8eccca-a0db-43e1-9b46-a52795c787da req-02ed1c48-c241-485b-a786-6d54aeb657a8 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 19:41:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:41:26 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Instance rebooted successfully.
Nov 14 19:41:26 user nova-compute[75205]: DEBUG nova.compute.manager [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:41:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-7e515c76-c27f-479d-8eb2-19a01138c4fa req-d4c085a8-0512-4b8d-a3a9-3dd8e3b03c8a service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:41:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7e515c76-c27f-479d-8eb2-19a01138c4fa req-d4c085a8-0512-4b8d-a3a9-3dd8e3b03c8a service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7e515c76-c27f-479d-8eb2-19a01138c4fa req-d4c085a8-0512-4b8d-a3a9-3dd8e3b03c8a service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-7e515c76-c27f-479d-8eb2-19a01138c4fa req-d4c085a8-0512-4b8d-a3a9-3dd8e3b03c8a service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:26 user nova-compute[75205]: DEBUG nova.compute.manager [req-7e515c76-c27f-479d-8eb2-19a01138c4fa req-d4c085a8-0512-4b8d-a3a9-3dd8e3b03c8a service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:41:26 user nova-compute[75205]: WARNING nova.compute.manager [req-7e515c76-c27f-479d-8eb2-19a01138c4fa req-d4c085a8-0512-4b8d-a3a9-3dd8e3b03c8a service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 19:41:26 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f289b9e7-bea6-44bc-9a4a-c36a93e8a2c8 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.533s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:36 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 43121bd9-325e-4328-8d35-1448d2dd3d23 is timed out.
Nov 14 19:41:36 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully detached device vdb from instance 43121bd9-325e-4328-8d35-1448d2dd3d23 from the live domain config.
Nov 14 19:41:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTFsPCrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:41:36 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a8f1ed-cdfe-42f9-9fec-65b82d0cd432]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:41:36 user nova-compute[75205]: No targets found.
Nov 14 19:41:36 user nova-compute[75205]: iSNS:
Nov 14 19:41:36 user nova-compute[75205]: No targets found.
Nov 14 19:41:36 user nova-compute[75205]: STATIC:
Nov 14 19:41:36 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1
Nov 14 19:41:36 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:41:36 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:41:36 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6
Nov 14 19:41:36 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:41:36 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:41:36 user nova-compute[75205]: FIRMWARE:
Nov 14 19:41:36 user nova-compute[75205]: No targets found.
Nov 14 19:41:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:41:36 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:41:36 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ba1d79-518a-4895-aa4b-5ead36618f4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e45a42-e90b-4f86-b68e-bf9c6581a23b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:36 user nova-compute[75205]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)
Nov 14 19:41:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 (non-flash)
Nov 14 19:41:36 user nova-compute[75205]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)
Nov 14 19:41:36 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb74145fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f599a-ff5a-49e4-9ff9-c2c8f5cb170d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[861d4c1f-bd85-4c72-b4c4-4d0c41b952dd]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:36 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[befdea26-4006-4ff6-be73-d4afc186fc34]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[463acf7d-6464-4180-99d6-b86646a1bffd]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1311a1b0-d8ab-459b-93c9-57bdfd1d7898]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684ec60-0737-40df-9e5c-ff23fe3ce90e]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260]
Nov 14 19:41:37 user nova-compute[75205]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1, portal: 172.16.0.220,3260] successful.
Nov 14 19:41:37 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e679453-a369-4c54-a519-4a9cfcac4da1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb56f501-3ba3-4340-8239-dbd7fcf4e3e7]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== disconnect_volume: return (284ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:41:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b68a1ea8-0735-4821-84bb-6c0fbf800527 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f2030d-514c-4a47-a7d4-2354dad809c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f2030d-514c-4a47-a7d4-2354dad809c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f2030d-514c-4a47-a7d4-2354dad809c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f2030d-514c-4a47-a7d4-2354dad809c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75205) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG nova.objects.instance [None req-e9f2030d-514c-4a47-a7d4-2354dad809c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-61bb6014-2791-4229-9b7b-df88c6d4031c req-a7770e1d-93f9-4803-9d4b-6f82aa1da242 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-unplugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:41:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-61bb6014-2791-4229-9b7b-df88c6d4031c req-a7770e1d-93f9-4803-9d4b-6f82aa1da242 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-61bb6014-2791-4229-9b7b-df88c6d4031c req-a7770e1d-93f9-4803-9d4b-6f82aa1da242 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-61bb6014-2791-4229-9b7b-df88c6d4031c req-a7770e1d-93f9-4803-9d4b-6f82aa1da242 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:39 user nova-compute[75205]: DEBUG nova.compute.manager [req-61bb6014-2791-4229-9b7b-df88c6d4031c req-a7770e1d-93f9-4803-9d4b-6f82aa1da242 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-unplugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:41:39 user nova-compute[75205]: WARNING nova.compute.manager [req-61bb6014-2791-4229-9b7b-df88c6d4031c req-a7770e1d-93f9-4803-9d4b-6f82aa1da242 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-unplugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state active and task_state powering-off.
Nov 14 19:41:39 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance destroyed successfully.
Nov 14 19:41:39 user nova-compute[75205]: DEBUG nova.compute.manager [None req-e9f2030d-514c-4a47-a7d4-2354dad809c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:41:39 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-e9f2030d-514c-4a47-a7d4-2354dad809c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.822s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-4c949130-eb42-40b0-a73d-e9f2cae7bf24 req-3f98610a-fcc4-4587-a598-f293d21f52e0 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:41:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4c949130-eb42-40b0-a73d-e9f2cae7bf24 req-3f98610a-fcc4-4587-a598-f293d21f52e0 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4c949130-eb42-40b0-a73d-e9f2cae7bf24 req-3f98610a-fcc4-4587-a598-f293d21f52e0 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4c949130-eb42-40b0-a73d-e9f2cae7bf24 req-3f98610a-fcc4-4587-a598-f293d21f52e0 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-4c949130-eb42-40b0-a73d-e9f2cae7bf24 req-3f98610a-fcc4-4587-a598-f293d21f52e0 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:41:41 user nova-compute[75205]: WARNING nova.compute.manager [req-4c949130-eb42-40b0-a73d-e9f2cae7bf24 req-3f98610a-fcc4-4587-a598-f293d21f52e0 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state stopped and task_state None.
Nov 14 19:41:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:46 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:47 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:41:47 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:41:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=25.00983428955078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:41:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:41:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:41:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:41:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:41:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:41:54 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:41:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:41:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:41:54 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:41:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:41:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:41:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:41:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:41:56 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:41:56 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:41:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:41:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:42:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:42:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:42:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:42:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:42:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:42:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:38 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:42:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:43 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:47 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:42:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:42:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:42:47 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:42:47 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:42:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:42:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:42:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:42:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:42:47 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:42:48 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:42:48 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:42:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=25.008934020996094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:42:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:42:49 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:42:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:42:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:42:52 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:42:53 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:53 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:42:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:42:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:42:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:42:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:42:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:42:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:42:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:42:55 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:42:55 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating instance_info_cache with network_info: [{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:42:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:42:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:42:56 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:42:57 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:42:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:42:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:42:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:42:58 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:43:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:43:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:43:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:08 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:43:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-68890a37-177f-40c4-bde4-3d47b728cba5 req-f0d3e30c-3285-4915-9306-ddb79ce42bc4 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-changed-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-68890a37-177f-40c4-bde4-3d47b728cba5 req-f0d3e30c-3285-4915-9306-ddb79ce42bc4 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Refreshing instance network info cache due to event network-changed-96fe9173-4e8b-435c-abc7-58a88afe1e39. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-68890a37-177f-40c4-bde4-3d47b728cba5 req-f0d3e30c-3285-4915-9306-ddb79ce42bc4 service nova] Acquiring lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-68890a37-177f-40c4-bde4-3d47b728cba5 req-f0d3e30c-3285-4915-9306-ddb79ce42bc4 service nova] Acquired lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG nova.network.neutron [req-68890a37-177f-40c4-bde4-3d47b728cba5 req-f0d3e30c-3285-4915-9306-ddb79ce42bc4 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Refreshing network info cache for port 96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG nova.network.neutron [req-68890a37-177f-40c4-bde4-3d47b728cba5 req-f0d3e30c-3285-4915-9306-ddb79ce42bc4 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updated VIF entry in instance network info cache for port 96fe9173-4e8b-435c-abc7-58a88afe1e39. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG nova.network.neutron [req-68890a37-177f-40c4-bde4-3d47b728cba5 req-f0d3e30c-3285-4915-9306-ddb79ce42bc4 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-68890a37-177f-40c4-bde4-3d47b728cba5 req-f0d3e30c-3285-4915-9306-ddb79ce42bc4 service nova] Releasing lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b8f3a124-d3f8-4ea2-aa9a-13dfd5803908 req-0d09d412-a827-4a2b-b166-757027ec7c47 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-changed-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-b8f3a124-d3f8-4ea2-aa9a-13dfd5803908 req-0d09d412-a827-4a2b-b166-757027ec7c47 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Refreshing instance network info cache due to event network-changed-96fe9173-4e8b-435c-abc7-58a88afe1e39. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b8f3a124-d3f8-4ea2-aa9a-13dfd5803908 req-0d09d412-a827-4a2b-b166-757027ec7c47 service nova] Acquiring lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b8f3a124-d3f8-4ea2-aa9a-13dfd5803908 req-0d09d412-a827-4a2b-b166-757027ec7c47 service nova] Acquired lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG nova.network.neutron [req-b8f3a124-d3f8-4ea2-aa9a-13dfd5803908 req-0d09d412-a827-4a2b-b166-757027ec7c47 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Refreshing network info cache for port 96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:43:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:43:11 user nova-compute[75205]: INFO nova.compute.manager [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Detaching volume 0fe23f61-de24-4038-b1fb-919d4a6c25b6
Nov 14 19:43:11 user nova-compute[75205]: INFO nova.virt.block_device [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Attempting to driver detach volume 0fe23f61-de24-4038-b1fb-919d4a6c25b6 from mountpoint /dev/vdb
Nov 14 19:43:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Attempting to detach device vdb from instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:43:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:43:12 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:43:12 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:43:12 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:43:12 user nova-compute[75205]:   <serial>0fe23f61-de24-4038-b1fb-919d4a6c25b6</serial>
Nov 14 19:43:12 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 19:43:12 user nova-compute[75205]: </disk>
Nov 14 19:43:12 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:43:12 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Successfully detached device vdb from instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 from the persistent domain config.
Nov 14 19:43:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:43:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:43:12 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:43:12 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:43:12 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:43:12 user nova-compute[75205]:   <serial>0fe23f61-de24-4038-b1fb-919d4a6c25b6</serial>
Nov 14 19:43:12 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 19:43:12 user nova-compute[75205]: </disk>
Nov 14 19:43:12 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:43:12 user nova-compute[75205]: DEBUG nova.network.neutron [req-b8f3a124-d3f8-4ea2-aa9a-13dfd5803908 req-0d09d412-a827-4a2b-b166-757027ec7c47 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updated VIF entry in instance network info cache for port 96fe9173-4e8b-435c-abc7-58a88afe1e39. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:43:12 user nova-compute[75205]: DEBUG nova.network.neutron [req-b8f3a124-d3f8-4ea2-aa9a-13dfd5803908 req-0d09d412-a827-4a2b-b166-757027ec7c47 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:43:12 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-b8f3a124-d3f8-4ea2-aa9a-13dfd5803908 req-0d09d412-a827-4a2b-b166-757027ec7c47 service nova] Releasing lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:43:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:43:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:13 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:43:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:43:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:43:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:43:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:43:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:43:23 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:28 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:29 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:43:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:43:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquired lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:43:29 user nova-compute[75205]: DEBUG nova.network.neutron [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:43:29 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'info_cache' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:43:29 user nova-compute[75205]: DEBUG nova.objects.base [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating instance_info_cache with network_info: [{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Releasing lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:43:30 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance destroyed successfully.
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'resources' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.base [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-321592417',display_name='tempest-AttachVolumeTestJSON-server-321592417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-321592417',id=47,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwkYbMF2eFIKA42xW5vusjYSx4d8QgjUMIaP8oZNrds3UxZnMzXAOuFIsJqr7xOLlKmCiZ6+648aTqutgtELdkijulMWKFIOLQwHhmQ7THLE7FldU881gEvk+xJb0lcdg==',key_name='tempest-keypair-594362825',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-96r2n4ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=43121bd9-325e-4328-8d35-1448d2dd3d23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG os_vif [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap745822ef-b3, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9559f8ea-06ca-4151-a516-6a1c3f1c8ea8) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:30 user nova-compute[75205]: INFO os_vif [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3')
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Start _get_guest_xml network_info=[{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'numa_topology' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.base [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:43:30 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:43:30 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.base [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-321592417',display_name='tempest-AttachVolumeTestJSON-server-321592417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-321592417',id=47,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwkYbMF2eFIKA42xW5vusjYSx4d8QgjUMIaP8oZNrds3UxZnMzXAOuFIsJqr7xOLlKmCiZ6+648aTqutgtELdkijulMWKFIOLQwHhmQ7THLE7FldU881gEvk+xJb0lcdg==',key_name='tempest-keypair-594362825',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-96r2n4ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=43121bd9-325e-4328-8d35-1448d2dd3d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'pci_devices' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.base [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:43:30 user nova-compute[75205]:   <uuid>43121bd9-325e-4328-8d35-1448d2dd3d23</uuid>
Nov 14 19:43:30 user nova-compute[75205]:   <name>instance-0000002f</name>
Nov 14 19:43:30 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:43:30 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:43:30 user nova-compute[75205]:   <metadata>
Nov 14 19:43:30 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:43:30 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:43:30 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeTestJSON-server-321592417</nova:name>
Nov 14 19:43:30 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:43:30</nova:creationTime>
Nov 14 19:43:30 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:43:30 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:43:30 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:43:30 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:43:30 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:43:30 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:43:30 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:43:30 user nova-compute[75205]:       <nova:owner>
Nov 14 19:43:30 user nova-compute[75205]:         <nova:user uuid="58202884478148cc892c360d7a2ee222">tempest-AttachVolumeTestJSON-282088086-project-member</nova:user>
Nov 14 19:43:30 user nova-compute[75205]:         <nova:project uuid="2a60993cb67d417194f8f9ef73e84550">tempest-AttachVolumeTestJSON-282088086</nova:project>
Nov 14 19:43:30 user nova-compute[75205]:       </nova:owner>
Nov 14 19:43:30 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:43:30 user nova-compute[75205]:       <nova:ports>
Nov 14 19:43:30 user nova-compute[75205]:         <nova:port uuid="745822ef-b300-4571-b0e6-392b770bb96c">
Nov 14 19:43:30 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 19:43:30 user nova-compute[75205]:         </nova:port>
Nov 14 19:43:30 user nova-compute[75205]:       </nova:ports>
Nov 14 19:43:30 user nova-compute[75205]:     </nova:instance>
Nov 14 19:43:30 user nova-compute[75205]:   </metadata>
Nov 14 19:43:30 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:43:30 user nova-compute[75205]:     <system>
Nov 14 19:43:30 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:43:30 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:43:30 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:43:30 user nova-compute[75205]:       <entry name="serial">43121bd9-325e-4328-8d35-1448d2dd3d23</entry>
Nov 14 19:43:30 user nova-compute[75205]:       <entry name="uuid">43121bd9-325e-4328-8d35-1448d2dd3d23</entry>
Nov 14 19:43:30 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:43:30 user nova-compute[75205]:     </system>
Nov 14 19:43:30 user nova-compute[75205]:   </sysinfo>
Nov 14 19:43:30 user nova-compute[75205]:   <os>
Nov 14 19:43:30 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:43:30 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:43:30 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:43:30 user nova-compute[75205]:   </os>
Nov 14 19:43:30 user nova-compute[75205]:   <features>
Nov 14 19:43:30 user nova-compute[75205]:     <acpi/>
Nov 14 19:43:30 user nova-compute[75205]:     <apic/>
Nov 14 19:43:30 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:43:30 user nova-compute[75205]:   </features>
Nov 14 19:43:30 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:43:30 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:43:30 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:43:30 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:43:30 user nova-compute[75205]:   </clock>
Nov 14 19:43:30 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:43:30 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:43:30 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:43:30 user nova-compute[75205]:   </cpu>
Nov 14 19:43:30 user nova-compute[75205]:   <devices>
Nov 14 19:43:30 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:43:30 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:43:30 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk"/>
Nov 14 19:43:30 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:43:30 user nova-compute[75205]:     </disk>
Nov 14 19:43:30 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:43:30 user nova-compute[75205]:       <mac address="fa:16:3e:15:70:50"/>
Nov 14 19:43:30 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:43:30 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:43:30 user nova-compute[75205]:       <target dev="tap745822ef-b3"/>
Nov 14 19:43:30 user nova-compute[75205]:     </interface>
Nov 14 19:43:30 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:43:30 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/console.log" append="off"/>
Nov 14 19:43:30 user nova-compute[75205]:     </serial>
Nov 14 19:43:30 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:43:30 user nova-compute[75205]:     <video>
Nov 14 19:43:30 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:43:30 user nova-compute[75205]:     </video>
Nov 14 19:43:30 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:43:30 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:43:30 user nova-compute[75205]:     </rng>
Nov 14 19:43:30 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:43:30 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:43:30 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:43:30 user nova-compute[75205]:     </memballoon>
Nov 14 19:43:30 user nova-compute[75205]:   </devices>
Nov 14 19:43:30 user nova-compute[75205]: </domain>
Nov 14 19:43:30 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'trusted_certs' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.base [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Cannot resize image /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'migration_context' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.objects.base [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Object Instance<43121bd9-325e-4328-8d35-1448d2dd3d23> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75205) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-321592417',display_name='tempest-AttachVolumeTestJSON-server-321592417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-321592417',id=47,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwkYbMF2eFIKA42xW5vusjYSx4d8QgjUMIaP8oZNrds3UxZnMzXAOuFIsJqr7xOLlKmCiZ6+648aTqutgtELdkijulMWKFIOLQwHhmQ7THLE7FldU881gEvk+xJb0lcdg==',key_name='tempest-keypair-594362825',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-96r2n4ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=43121bd9-325e-4328-8d35-1448d2dd3d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG os_vif [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4af0f320-c38b-5109-9c79-5c42dceb2584', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap745822ef-b3, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap745822ef-b3, col_values=(('qos', UUID('fd1bdfa5-247f-4cdf-aaa3-b66c36505e37')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap745822ef-b3, col_values=(('external_ids', {'iface-id': '745822ef-b300-4571-b0e6-392b770bb96c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:70:50', 'vm-uuid': '43121bd9-325e-4328-8d35-1448d2dd3d23'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:43:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:30 user nova-compute[75205]: INFO os_vif [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3')
Nov 14 19:43:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:32 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 is timed out.
Nov 14 19:43:32 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Successfully detached device vdb from instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 from the live domain config.
Nov 14 19:43:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-dc8ed199-744c-4094-9ef1-7132586c7274 req-559835a0-5715-4e62-8122-40304cbf0427 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dc8ed199-744c-4094-9ef1-7132586c7274 req-559835a0-5715-4e62-8122-40304cbf0427 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dc8ed199-744c-4094-9ef1-7132586c7274 req-559835a0-5715-4e62-8122-40304cbf0427 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-dc8ed199-744c-4094-9ef1-7132586c7274 req-559835a0-5715-4e62-8122-40304cbf0427 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-dc8ed199-744c-4094-9ef1-7132586c7274 req-559835a0-5715-4e62-8122-40304cbf0427 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:43:32 user nova-compute[75205]: WARNING nova.compute.manager [req-dc8ed199-744c-4094-9ef1-7132586c7274 req-559835a0-5715-4e62-8122-40304cbf0427 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state stopped and task_state powering-on.
Nov 14 19:43:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiDJOIUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:43:32 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1470c58-e95b-4710-b0c6-257408dc8dac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:43:32 user nova-compute[75205]: No targets found.
Nov 14 19:43:32 user nova-compute[75205]: iSNS:
Nov 14 19:43:32 user nova-compute[75205]: No targets found.
Nov 14 19:43:32 user nova-compute[75205]: STATIC:
Nov 14 19:43:32 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6
Nov 14 19:43:32 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:43:32 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:43:32 user nova-compute[75205]: FIRMWARE:
Nov 14 19:43:32 user nova-compute[75205]: No targets found.
Nov 14 19:43:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:43:32 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:43:32 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f7f337-160b-48da-810d-3d7b390b5fc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b72708-1923-4b52-809f-b1931921599d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)
Nov 14 19:43:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 (non-flash)
Nov 14 19:43:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb742ddf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4c11f8-46d4-4f8e-adaf-fba52195e30b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[829047d3-ea1a-4bd6-9075-da7acf7a7e09]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e924c8d5-024f-40de-9fa1-6a80c4c083f1]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05c2de6-0a76-4208-811e-ab1d40e68624]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[88364310-d36c-4e61-bb1f-6db2fcc06b2b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[720ad997-a6b0-4dc5-a02a-3556f0ed4d97]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260]
Nov 14 19:43:32 user nova-compute[75205]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6, portal: 172.16.0.220,3260] successful.
Nov 14 19:43:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fe23f61-de24-4038-b1fb-919d4a6c25b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c069f6d-9566-4fa0-a05e-fa8a80b0ab5b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] <== disconnect_volume: return (298ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:33 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'flavor' on Instance uuid 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:43:33 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3527c3a4-da4c-48f3-96ca-eee01a824af7 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.657s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:43:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:43:34 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance rebooted successfully.
Nov 14 19:43:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-cc2afac0-5ab4-4a03-a55c-318ef8995b46 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:43:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-fdae817e-14fd-42f3-969d-967073e92fec req-5504161d-e6e2-45d1-9ee1-afc188436ad8 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:43:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fdae817e-14fd-42f3-969d-967073e92fec req-5504161d-e6e2-45d1-9ee1-afc188436ad8 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:43:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fdae817e-14fd-42f3-969d-967073e92fec req-5504161d-e6e2-45d1-9ee1-afc188436ad8 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:43:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fdae817e-14fd-42f3-969d-967073e92fec req-5504161d-e6e2-45d1-9ee1-afc188436ad8 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:43:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-fdae817e-14fd-42f3-969d-967073e92fec req-5504161d-e6e2-45d1-9ee1-afc188436ad8 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:43:34 user nova-compute[75205]: WARNING nova.compute.manager [req-fdae817e-14fd-42f3-969d-967073e92fec req-5504161d-e6e2-45d1-9ee1-afc188436ad8 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state stopped and task_state powering-on.
Nov 14 19:43:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:43:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:43:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:43:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:43:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:43:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:43:49 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:43:49 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:43:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=25.007434844970703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:43:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:43:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:43:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:43:50 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:43:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:43:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:43:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:56 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:43:57 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:43:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:43:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:43:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:43:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:43:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:43:57 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [{"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:43:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-3b69180c-5fb5-43b8-92ea-1cce7b036da9" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:43:57 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:43:57 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:43:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:44:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:04 user nova-compute[75205]: INFO nova.compute.manager [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Terminating instance
Nov 14 19:44:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-e1497c2e-5903-4e09-a046-d0f24379aa93 req-94545c13-7eff-4535-a369-ec79ac9aaab2 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-unplugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e1497c2e-5903-4e09-a046-d0f24379aa93 req-94545c13-7eff-4535-a369-ec79ac9aaab2 service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e1497c2e-5903-4e09-a046-d0f24379aa93 req-94545c13-7eff-4535-a369-ec79ac9aaab2 service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e1497c2e-5903-4e09-a046-d0f24379aa93 req-94545c13-7eff-4535-a369-ec79ac9aaab2 service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-e1497c2e-5903-4e09-a046-d0f24379aa93 req-94545c13-7eff-4535-a369-ec79ac9aaab2 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-unplugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:44:04 user nova-compute[75205]: DEBUG nova.compute.manager [req-e1497c2e-5903-4e09-a046-d0f24379aa93 req-94545c13-7eff-4535-a369-ec79ac9aaab2 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-unplugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Instance destroyed successfully.
Nov 14 19:44:05 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'resources' on Instance uuid 3b69180c-5fb5-43b8-92ea-1cce7b036da9 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-659509003',display_name='tempest-TestMinimumBasicScenario-server-659509003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-659509003',id=50,image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoRxAXyyRyvp4ISDz44uTTzcyrFRN+Y/Y6dglFi6JGQNUuyn0u6gRZz/CVA0g0KRYfKYzktzAwrrjSC37i4fwtYzQQQ6rSDkDkgIucLmh36ObtAppZg7HW21KcMeNUJSA==',key_name='tempest-TestMinimumBasicScenario-1815893540',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d749beb4f34d2fafa10b4a3cdbab88',ramdisk_id='',reservation_id='r-o6g8z44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73c45d86-1d4b-4749-ba39-4186e7c098f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-400789003',owner_user_name='tempest-TestMinimumBasicScenario-400789003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:41:27Z,user_data=None,user_id='949d766f59384494943cb27d5bbc3b95',uuid=3b69180c-5fb5-43b8-92ea-1cce7b036da9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converting VIF {"id": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "address": "fa:16:3e:70:39:e6", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fe9173-4e", "ovs_interfaceid": "96fe9173-4e8b-435c-abc7-58a88afe1e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG os_vif [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96fe9173-4e, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1e87b42-1d5a-45f0-b36d-273fb02916e6) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:05 user nova-compute[75205]: INFO os_vif [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:39:e6,bridge_name='br-int',has_traffic_filtering=True,id=96fe9173-4e8b-435c-abc7-58a88afe1e39,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fe9173-4e')
Nov 14 19:44:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Deleting instance files /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9_del
Nov 14 19:44:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Deletion of /opt/stack/data/nova/instances/3b69180c-5fb5-43b8-92ea-1cce7b036da9_del complete
Nov 14 19:44:05 user nova-compute[75205]: INFO nova.compute.manager [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 19:44:05 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-5614d441-1307-47e7-8636-8d36b24863bd req-901ee22f-5946-4855-9e88-ca54987a5992 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-deleted-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:44:06 user nova-compute[75205]: INFO nova.compute.manager [req-5614d441-1307-47e7-8636-8d36b24863bd req-901ee22f-5946-4855-9e88-ca54987a5992 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Neutron deleted interface 96fe9173-4e8b-435c-abc7-58a88afe1e39; detaching it from the instance and deleting it from the info cache
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.network.neutron [req-5614d441-1307-47e7-8636-8d36b24863bd req-901ee22f-5946-4855-9e88-ca54987a5992 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:06 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Took 0.60 seconds to deallocate network for instance.
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-5614d441-1307-47e7-8636-8d36b24863bd req-901ee22f-5946-4855-9e88-ca54987a5992 service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Detach interface failed, port_id=96fe9173-4e8b-435c-abc7-58a88afe1e39, reason: Instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9 could not be found. {{(pid=75205) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:06 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Deleted allocations for instance 3b69180c-5fb5-43b8-92ea-1cce7b036da9
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5987c549-6a42-4386-81bd-053f386de5db tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.809s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:44:06 user nova-compute[75205]: WARNING nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state deleted and task_state None.
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:44:06 user nova-compute[75205]: WARNING nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state deleted and task_state None.
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:44:06 user nova-compute[75205]: WARNING nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state deleted and task_state None.
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-unplugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-unplugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:44:06 user nova-compute[75205]: WARNING nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-unplugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state deleted and task_state None.
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Acquiring lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] Lock "3b69180c-5fb5-43b8-92ea-1cce7b036da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:06 user nova-compute[75205]: DEBUG nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] No waiting events found dispatching network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:44:06 user nova-compute[75205]: WARNING nova.compute.manager [req-d41e8598-e88d-4495-a913-7169a4afcb76 req-fab2bccd-db94-4b0a-9a9e-ce3a425ae2ed service nova] [instance: 3b69180c-5fb5-43b8-92ea-1cce7b036da9] Received unexpected event network-vif-plugged-96fe9173-4e8b-435c-abc7-58a88afe1e39 for instance with vm_state deleted and task_state None.
Nov 14 19:44:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Verify base images {{(pid=75205) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Image id 992ee33c-41f8-4ea7-bc15-8d73f5a51f6d yields fingerprint 0fe91193df1c40dd26113d6286d0d3c3e62b24de {{(pid=75205) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] image 992ee33c-41f8-4ea7-bc15-8d73f5a51f6d at (/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de): checking
Nov 14 19:44:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] image 992ee33c-41f8-4ea7-bc15-8d73f5a51f6d at (/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de): image is in use {{(pid=75205) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75205) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] 43121bd9-325e-4328-8d35-1448d2dd3d23 is a valid instance name {{(pid=75205) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] 43121bd9-325e-4328-8d35-1448d2dd3d23 has a disk file {{(pid=75205) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 is backed by 0fe91193df1c40dd26113d6286d0d3c3e62b24de {{(pid=75205) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 19:44:15 user nova-compute[75205]: WARNING nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180
Nov 14 19:44:15 user nova-compute[75205]: WARNING nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e
Nov 14 19:44:15 user nova-compute[75205]: WARNING nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb
Nov 14 19:44:15 user nova-compute[75205]: WARNING nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401
Nov 14 19:44:15 user nova-compute[75205]: WARNING nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc
Nov 14 19:44:15 user nova-compute[75205]: WARNING nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f
Nov 14 19:44:15 user nova-compute[75205]: WARNING nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818
Nov 14 19:44:15 user nova-compute[75205]: WARNING nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Unknown base file: /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Active base files: /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Removable base files: /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180 /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401 /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818 /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0b10fa9bd5166603ea168d7fa6adf95cb8fea180
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9ccd677ae5cdbddf4deaece27d68b0d9d9950a2e
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ea18f65a942ff031ac519d01b6bb77e340d70ffb
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2dd6d4573eab05707cf804e45aad79f0d0c6a401
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/55c23c2189cbdd72f222fd91a30b32a3da9f65dc
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/786f982d08a24e7900db4432ce3f0e84634fa07f
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/804d885052f50757d09556d31ae90dcb33cbf818
Nov 14 19:44:15 user nova-compute[75205]: INFO nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/525d54958ff64ee24fdc4fad67e4aed0a11b620b
Nov 14 19:44:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Verification complete {{(pid=75205) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Verify swap images {{(pid=75205) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 19:44:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.imagecache [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Verify ephemeral images {{(pid=75205) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 19:44:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:44:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:44:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:44:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:44:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:44:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:44:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:44:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:44:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:44:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:44:49 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:44:49 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:44:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=25.034427642822266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:44:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 43121bd9-325e-4328-8d35-1448d2dd3d23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:44:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:44:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:44:49 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:44:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:44:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:44:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:44:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:44:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:44:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:44:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:44:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:44:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:44:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:44:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:44:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:56 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:44:57 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:44:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:44:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:58 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:44:58 user nova-compute[75205]: INFO nova.compute.claims [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Claim successful on node user
Nov 14 19:44:58 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:44:58 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.network.neutron [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:44:59 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.policy [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '949d766f59384494943cb27d5bbc3b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d749beb4f34d2fafa10b4a3cdbab88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:44:59 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Creating image(s)
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "/opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "/opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "944b9d2c3735d30eb409739dc41184086e02c832" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "944b9d2c3735d30eb409739dc41184086e02c832" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832.part --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Skipping network cache update for instance because it is Building. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.network.neutron [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Successfully created port: 619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.virt.images [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] 60412d6d-285d-4b1a-a56c-a41aedd96723 was qcow2, converting to raw {{(pid=75205) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG nova.privsep.utils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75205) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 19:44:59 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832.part /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832.converted {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832.part /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832.converted" returned: 0 in 0.318s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832.converted --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "944b9d2c3735d30eb409739dc41184086e02c832" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.108s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832 --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.network.neutron [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Successfully updated port: 619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-a407d460-b405-497f-9740-14c9fee57a86 req-8fa5f7b8-4465-4047-be30-22dc35d23268 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-changed-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-a407d460-b405-497f-9740-14c9fee57a86 req-8fa5f7b8-4465-4047-be30-22dc35d23268 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Refreshing instance network info cache due to event network-changed-619e7fe6-d7ae-413b-9d12-92298997364b. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a407d460-b405-497f-9740-14c9fee57a86 req-8fa5f7b8-4465-4047-be30-22dc35d23268 service nova] Acquiring lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a407d460-b405-497f-9740-14c9fee57a86 req-8fa5f7b8-4465-4047-be30-22dc35d23268 service nova] Acquired lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.network.neutron [req-a407d460-b405-497f-9740-14c9fee57a86 req-8fa5f7b8-4465-4047-be30-22dc35d23268 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Refreshing network info cache for port 619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating instance_info_cache with network_info: [{"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.network.neutron [req-a407d460-b405-497f-9740-14c9fee57a86 req-8fa5f7b8-4465-4047-be30-22dc35d23268 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832 --force-share --output=json" returned: 0 in 0.212s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "944b9d2c3735d30eb409739dc41184086e02c832" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "944b9d2c3735d30eb409739dc41184086e02c832" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832 --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-43121bd9-325e-4328-8d35-1448d2dd3d23" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.network.neutron [req-a407d460-b405-497f-9740-14c9fee57a86 req-8fa5f7b8-4465-4047-be30-22dc35d23268 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] There are 0 instances to clean {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a407d460-b405-497f-9740-14c9fee57a86 req-8fa5f7b8-4465-4047-be30-22dc35d23268 service nova] Releasing lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquired lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.network.neutron [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.network.neutron [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832 --force-share --output=json" returned: 0 in 0.166s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832,backing_fmt=raw /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832,backing_fmt=raw /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk 1073741824" returned: 0 in 0.059s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "944b9d2c3735d30eb409739dc41184086e02c832" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832 --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/944b9d2c3735d30eb409739dc41184086e02c832 --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:45:00 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Cannot resize image /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Ensure instance console log exists: /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.network.neutron [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Releasing lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.compute.manager [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Instance network_info: |[{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Start _get_guest_xml network_info=[{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:44:56Z,direct_url=<?>,disk_format='qcow2',id=60412d6d-285d-4b1a-a56c-a41aedd96723,min_disk=0,min_ram=0,name='tempest-scenario-img--991222030',owner='32d749beb4f34d2fafa10b4a3cdbab88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:44:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '60412d6d-285d-4b1a-a56c-a41aedd96723'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:45:01 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:45:01 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:44:56Z,direct_url=<?>,disk_format='qcow2',id=60412d6d-285d-4b1a-a56c-a41aedd96723,min_disk=0,min_ram=0,name='tempest-scenario-img--991222030',owner='32d749beb4f34d2fafa10b4a3cdbab88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:44:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1777501226',display_name='tempest-TestMinimumBasicScenario-server-1777501226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1777501226',id=51,image_ref='60412d6d-285d-4b1a-a56c-a41aedd96723',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeaR2rL70mY+QZjywt2NvsEknULlLC3GplsIvEfB7Vz+TOwD9W4rIBLDfn2nyE0UnKwy2/JqZkquEPj2sDoGQe66l4JZBgOeGn7Qc9mJXPukiR4+BEJPm4NDh2Mbr/VSA==',key_name='tempest-TestMinimumBasicScenario-982926860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d749beb4f34d2fafa10b4a3cdbab88',ramdisk_id='',reservation_id='r-5mitn57g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='60412d6d-285d-4b1a-a56c-a41aedd96723',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-400789003',owner_user_name='tempest-TestMinimumBasicScenario-400789003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:44:59Z,user_data=None,user_id='949d766f59384494943cb27d5bbc3b95',uuid=bb6adf57-89a2-4b72-8520-504007ba66ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converting VIF {"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:71:47,bridge_name='br-int',has_traffic_filtering=True,id=619e7fe6-d7ae-413b-9d12-92298997364b,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619e7fe6-d7') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.objects.instance [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'pci_devices' on Instance uuid bb6adf57-89a2-4b72-8520-504007ba66ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:45:01 user nova-compute[75205]:   <uuid>bb6adf57-89a2-4b72-8520-504007ba66ca</uuid>
Nov 14 19:45:01 user nova-compute[75205]:   <name>instance-00000033</name>
Nov 14 19:45:01 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:45:01 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:45:01 user nova-compute[75205]:   <metadata>
Nov 14 19:45:01 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:45:01 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:45:01 user nova-compute[75205]:       <nova:name>tempest-TestMinimumBasicScenario-server-1777501226</nova:name>
Nov 14 19:45:01 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:45:01</nova:creationTime>
Nov 14 19:45:01 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:45:01 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:45:01 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:45:01 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:45:01 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:45:01 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:45:01 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:45:01 user nova-compute[75205]:       <nova:owner>
Nov 14 19:45:01 user nova-compute[75205]:         <nova:user uuid="949d766f59384494943cb27d5bbc3b95">tempest-TestMinimumBasicScenario-400789003-project-member</nova:user>
Nov 14 19:45:01 user nova-compute[75205]:         <nova:project uuid="32d749beb4f34d2fafa10b4a3cdbab88">tempest-TestMinimumBasicScenario-400789003</nova:project>
Nov 14 19:45:01 user nova-compute[75205]:       </nova:owner>
Nov 14 19:45:01 user nova-compute[75205]:       <nova:root type="image" uuid="60412d6d-285d-4b1a-a56c-a41aedd96723"/>
Nov 14 19:45:01 user nova-compute[75205]:       <nova:ports>
Nov 14 19:45:01 user nova-compute[75205]:         <nova:port uuid="619e7fe6-d7ae-413b-9d12-92298997364b">
Nov 14 19:45:01 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 19:45:01 user nova-compute[75205]:         </nova:port>
Nov 14 19:45:01 user nova-compute[75205]:       </nova:ports>
Nov 14 19:45:01 user nova-compute[75205]:     </nova:instance>
Nov 14 19:45:01 user nova-compute[75205]:   </metadata>
Nov 14 19:45:01 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:45:01 user nova-compute[75205]:     <system>
Nov 14 19:45:01 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:45:01 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:45:01 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:45:01 user nova-compute[75205]:       <entry name="serial">bb6adf57-89a2-4b72-8520-504007ba66ca</entry>
Nov 14 19:45:01 user nova-compute[75205]:       <entry name="uuid">bb6adf57-89a2-4b72-8520-504007ba66ca</entry>
Nov 14 19:45:01 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:45:01 user nova-compute[75205]:     </system>
Nov 14 19:45:01 user nova-compute[75205]:   </sysinfo>
Nov 14 19:45:01 user nova-compute[75205]:   <os>
Nov 14 19:45:01 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:45:01 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:45:01 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:45:01 user nova-compute[75205]:   </os>
Nov 14 19:45:01 user nova-compute[75205]:   <features>
Nov 14 19:45:01 user nova-compute[75205]:     <acpi/>
Nov 14 19:45:01 user nova-compute[75205]:     <apic/>
Nov 14 19:45:01 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:45:01 user nova-compute[75205]:   </features>
Nov 14 19:45:01 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:45:01 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:45:01 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:45:01 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:45:01 user nova-compute[75205]:   </clock>
Nov 14 19:45:01 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:45:01 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:45:01 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:45:01 user nova-compute[75205]:   </cpu>
Nov 14 19:45:01 user nova-compute[75205]:   <devices>
Nov 14 19:45:01 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:45:01 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:45:01 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk"/>
Nov 14 19:45:01 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:45:01 user nova-compute[75205]:     </disk>
Nov 14 19:45:01 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:45:01 user nova-compute[75205]:       <mac address="fa:16:3e:6e:71:47"/>
Nov 14 19:45:01 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:45:01 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:45:01 user nova-compute[75205]:       <target dev="tap619e7fe6-d7"/>
Nov 14 19:45:01 user nova-compute[75205]:     </interface>
Nov 14 19:45:01 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:45:01 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/console.log" append="off"/>
Nov 14 19:45:01 user nova-compute[75205]:     </serial>
Nov 14 19:45:01 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:45:01 user nova-compute[75205]:     <video>
Nov 14 19:45:01 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:45:01 user nova-compute[75205]:     </video>
Nov 14 19:45:01 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:45:01 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:45:01 user nova-compute[75205]:     </rng>
Nov 14 19:45:01 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:45:01 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:45:01 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:45:01 user nova-compute[75205]:     </memballoon>
Nov 14 19:45:01 user nova-compute[75205]:   </devices>
Nov 14 19:45:01 user nova-compute[75205]: </domain>
Nov 14 19:45:01 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1777501226',display_name='tempest-TestMinimumBasicScenario-server-1777501226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1777501226',id=51,image_ref='60412d6d-285d-4b1a-a56c-a41aedd96723',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeaR2rL70mY+QZjywt2NvsEknULlLC3GplsIvEfB7Vz+TOwD9W4rIBLDfn2nyE0UnKwy2/JqZkquEPj2sDoGQe66l4JZBgOeGn7Qc9mJXPukiR4+BEJPm4NDh2Mbr/VSA==',key_name='tempest-TestMinimumBasicScenario-982926860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d749beb4f34d2fafa10b4a3cdbab88',ramdisk_id='',reservation_id='r-5mitn57g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='60412d6d-285d-4b1a-a56c-a41aedd96723',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-400789003',owner_user_name='tempest-TestMinimumBasicScenario-400789003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:44:59Z,user_data=None,user_id='949d766f59384494943cb27d5bbc3b95',uuid=bb6adf57-89a2-4b72-8520-504007ba66ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converting VIF {"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:71:47,bridge_name='br-int',has_traffic_filtering=True,id=619e7fe6-d7ae-413b-9d12-92298997364b,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619e7fe6-d7') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG os_vif [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:71:47,bridge_name='br-int',has_traffic_filtering=True,id=619e7fe6-d7ae-413b-9d12-92298997364b,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619e7fe6-d7') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '032ce239-5539-5f93-aded-d909dbc914c0', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap619e7fe6-d7, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap619e7fe6-d7, col_values=(('qos', UUID('16750fb0-6aac-4070-9523-58273076523d')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap619e7fe6-d7, col_values=(('external_ids', {'iface-id': '619e7fe6-d7ae-413b-9d12-92298997364b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:71:47', 'vm-uuid': 'bb6adf57-89a2-4b72-8520-504007ba66ca'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:01 user nova-compute[75205]: INFO os_vif [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:71:47,bridge_name='br-int',has_traffic_filtering=True,id=619e7fe6-d7ae-413b-9d12-92298997364b,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619e7fe6-d7')
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:45:01 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] No VIF found with MAC fa:16:3e:6e:71:47, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:45:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-fbfccb4d-732e-40ee-84e4-5800379de3ea req-a7f7e923-cc8e-4a40-a0d4-b136aa692f98 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:45:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fbfccb4d-732e-40ee-84e4-5800379de3ea req-a7f7e923-cc8e-4a40-a0d4-b136aa692f98 service nova] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fbfccb4d-732e-40ee-84e4-5800379de3ea req-a7f7e923-cc8e-4a40-a0d4-b136aa692f98 service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-fbfccb4d-732e-40ee-84e4-5800379de3ea req-a7f7e923-cc8e-4a40-a0d4-b136aa692f98 service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-fbfccb4d-732e-40ee-84e4-5800379de3ea req-a7f7e923-cc8e-4a40-a0d4-b136aa692f98 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] No waiting events found dispatching network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:45:03 user nova-compute[75205]: WARNING nova.compute.manager [req-fbfccb4d-732e-40ee-84e4-5800379de3ea req-a7f7e923-cc8e-4a40-a0d4-b136aa692f98 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received unexpected event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b for instance with vm_state building and task_state spawning.
Nov 14 19:45:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:03 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.compute.manager [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:45:05 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Instance spawned successfully.
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:45:05 user nova-compute[75205]: INFO nova.compute.manager [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.compute.manager [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-841d4306-044b-43e3-948b-5eda3d393880 req-f11b9eb8-f265-4057-934e-fe6eb79816ec service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-841d4306-044b-43e3-948b-5eda3d393880 req-f11b9eb8-f265-4057-934e-fe6eb79816ec service nova] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-841d4306-044b-43e3-948b-5eda3d393880 req-f11b9eb8-f265-4057-934e-fe6eb79816ec service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-841d4306-044b-43e3-948b-5eda3d393880 req-f11b9eb8-f265-4057-934e-fe6eb79816ec service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-841d4306-044b-43e3-948b-5eda3d393880 req-f11b9eb8-f265-4057-934e-fe6eb79816ec service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] No waiting events found dispatching network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:45:05 user nova-compute[75205]: WARNING nova.compute.manager [req-841d4306-044b-43e3-948b-5eda3d393880 req-f11b9eb8-f265-4057-934e-fe6eb79816ec service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received unexpected event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b for instance with vm_state building and task_state spawning.
Nov 14 19:45:05 user nova-compute[75205]: INFO nova.compute.manager [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Took 6.58 seconds to build instance.
Nov 14 19:45:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-741fadc7-6bc1-4f11-b6cc-112e4cb5b7d5 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.676s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:06 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:06 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75205) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 19:45:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:09 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:13 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:45:13 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid bb6adf57-89a2-4b72-8520-504007ba66ca {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:45:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:13 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:20 user nova-compute[75205]: INFO nova.compute.manager [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Terminating instance
Nov 14 19:45:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-8442b3ab-b158-4ef1-8fbd-d0a1adf5b4b2 req-b6cae527-d189-430a-aa22-3107215520c6 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-unplugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8442b3ab-b158-4ef1-8fbd-d0a1adf5b4b2 req-b6cae527-d189-430a-aa22-3107215520c6 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8442b3ab-b158-4ef1-8fbd-d0a1adf5b4b2 req-b6cae527-d189-430a-aa22-3107215520c6 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-8442b3ab-b158-4ef1-8fbd-d0a1adf5b4b2 req-b6cae527-d189-430a-aa22-3107215520c6 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-8442b3ab-b158-4ef1-8fbd-d0a1adf5b4b2 req-b6cae527-d189-430a-aa22-3107215520c6 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-unplugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:45:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-8442b3ab-b158-4ef1-8fbd-d0a1adf5b4b2 req-b6cae527-d189-430a-aa22-3107215520c6 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-unplugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:45:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Instance destroyed successfully.
Nov 14 19:45:21 user nova-compute[75205]: DEBUG nova.objects.instance [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'resources' on Instance uuid 43121bd9-325e-4328-8d35-1448d2dd3d23 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-321592417',display_name='tempest-AttachVolumeTestJSON-server-321592417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-321592417',id=47,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwkYbMF2eFIKA42xW5vusjYSx4d8QgjUMIaP8oZNrds3UxZnMzXAOuFIsJqr7xOLlKmCiZ6+648aTqutgtELdkijulMWKFIOLQwHhmQ7THLE7FldU881gEvk+xJb0lcdg==',key_name='tempest-keypair-594362825',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-96r2n4ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=43121bd9-325e-4328-8d35-1448d2dd3d23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "745822ef-b300-4571-b0e6-392b770bb96c", "address": "fa:16:3e:15:70:50", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745822ef-b3", "ovs_interfaceid": "745822ef-b300-4571-b0e6-392b770bb96c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG os_vif [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap745822ef-b3, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd1bdfa5-247f-4cdf-aaa3-b66c36505e37) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:45:21 user nova-compute[75205]: INFO os_vif [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:70:50,bridge_name='br-int',has_traffic_filtering=True,id=745822ef-b300-4571-b0e6-392b770bb96c,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745822ef-b3')
Nov 14 19:45:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Deleting instance files /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23_del
Nov 14 19:45:21 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Deletion of /opt/stack/data/nova/instances/43121bd9-325e-4328-8d35-1448d2dd3d23_del complete
Nov 14 19:45:21 user nova-compute[75205]: INFO nova.compute.manager [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 19:45:21 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:45:21 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:45:22 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Took 0.70 seconds to deallocate network for instance.
Nov 14 19:45:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-57572e8b-73d4-4038-acc7-def605b105a0 req-76b94d08-28da-483d-a4be-6b78ba6ff7a0 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-deleted-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:22 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Deleted allocations for instance 43121bd9-325e-4328-8d35-1448d2dd3d23
Nov 14 19:45:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-70f4bc2a-3903-4d03-8189-b302c609555c tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.866s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-61ab0e80-0842-4196-b0c8-0cd1aa68cb2b req-d31a3d5f-fbcb-43f0-bf64-4660ea78ddb4 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-61ab0e80-0842-4196-b0c8-0cd1aa68cb2b req-d31a3d5f-fbcb-43f0-bf64-4660ea78ddb4 service nova] Acquiring lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-61ab0e80-0842-4196-b0c8-0cd1aa68cb2b req-d31a3d5f-fbcb-43f0-bf64-4660ea78ddb4 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-61ab0e80-0842-4196-b0c8-0cd1aa68cb2b req-d31a3d5f-fbcb-43f0-bf64-4660ea78ddb4 service nova] Lock "43121bd9-325e-4328-8d35-1448d2dd3d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:22 user nova-compute[75205]: DEBUG nova.compute.manager [req-61ab0e80-0842-4196-b0c8-0cd1aa68cb2b req-d31a3d5f-fbcb-43f0-bf64-4660ea78ddb4 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] No waiting events found dispatching network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:45:22 user nova-compute[75205]: WARNING nova.compute.manager [req-61ab0e80-0842-4196-b0c8-0cd1aa68cb2b req-d31a3d5f-fbcb-43f0-bf64-4660ea78ddb4 service nova] [instance: 43121bd9-325e-4328-8d35-1448d2dd3d23] Received unexpected event network-vif-plugged-745822ef-b300-4571-b0e6-392b770bb96c for instance with vm_state deleted and task_state None.
Nov 14 19:45:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:45:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:45:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:45:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:45:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:45:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:45:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:45:49 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:45:49 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8916MB free_disk=25.004241943359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance bb6adf57-89a2-4b72-8520-504007ba66ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing inventories for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Updating ProviderTree inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing aggregate associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, aggregates: None {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing trait associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, traits: HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:45:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:45:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:45:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:51 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:51 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:45:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:45:57 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:45:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:46:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:46:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:46:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:46:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:46:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:46:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:46:00 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:46:00 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid bb6adf57-89a2-4b72-8520-504007ba66ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:46:00 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:46:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:46:01 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:46:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:46:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:46:14 user nova-compute[75205]: INFO nova.compute.claims [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Claim successful on node user
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:46:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.policy [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58202884478148cc892c360d7a2ee222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a60993cb67d417194f8f9ef73e84550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:46:14 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Creating image(s)
Nov 14 19:46:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "/opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "/opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "/opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:14 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk 1073741824" returned: 0 in 0.050s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Successfully created port: 5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Cannot resize image /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Ensure instance console log exists: /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:15 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Successfully updated port: 5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquired lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-e7e6814a-243e-4fc8-a0dd-0e8b6ac108bd req-cc203aa4-d259-4625-b5ce-e1e918a30d17 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received event network-changed-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.compute.manager [req-e7e6814a-243e-4fc8-a0dd-0e8b6ac108bd req-cc203aa4-d259-4625-b5ce-e1e918a30d17 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Refreshing instance network info cache due to event network-changed-5072b761-791b-4a1c-bec4-ca316dcf322b. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e7e6814a-243e-4fc8-a0dd-0e8b6ac108bd req-cc203aa4-d259-4625-b5ce-e1e918a30d17 service nova] Acquiring lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.neutron [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Updating instance_info_cache with network_info: [{"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Releasing lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Instance network_info: |[{"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e7e6814a-243e-4fc8-a0dd-0e8b6ac108bd req-cc203aa4-d259-4625-b5ce-e1e918a30d17 service nova] Acquired lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.neutron [req-e7e6814a-243e-4fc8-a0dd-0e8b6ac108bd req-cc203aa4-d259-4625-b5ce-e1e918a30d17 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Refreshing network info cache for port 5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Start _get_guest_xml network_info=[{"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:46:16 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:46:16 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-405787254',display_name='tempest-AttachVolumeTestJSON-server-405787254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-405787254',id=52,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN35V3dim2V/Bf7xM7/gVV1A8XdX+OsrCHsO2AHNl7ihPtswqE8P1QCHuWkTcpKuOJahqPIJJTsyGB5L9KHplODHOpSSsyEJMmjdyGsv0Mqsf7EFvL0H0TcBsR66ip2AuQ==',key_name='tempest-keypair-1825129783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-h7li7sra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=61e2b2db-66c5-4489-a6ce-1be4d38c556c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=5072b761-791b-4a1c-bec4-ca316dcf322b,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5072b761-79') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'pci_devices' on Instance uuid 61e2b2db-66c5-4489-a6ce-1be4d38c556c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:46:16 user nova-compute[75205]:   <uuid>61e2b2db-66c5-4489-a6ce-1be4d38c556c</uuid>
Nov 14 19:46:16 user nova-compute[75205]:   <name>instance-00000034</name>
Nov 14 19:46:16 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:46:16 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:46:16 user nova-compute[75205]:   <metadata>
Nov 14 19:46:16 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:46:16 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:46:16 user nova-compute[75205]:       <nova:name>tempest-AttachVolumeTestJSON-server-405787254</nova:name>
Nov 14 19:46:16 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:46:16</nova:creationTime>
Nov 14 19:46:16 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:46:16 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:46:16 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:46:16 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:46:16 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:46:16 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:46:16 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:46:16 user nova-compute[75205]:       <nova:owner>
Nov 14 19:46:16 user nova-compute[75205]:         <nova:user uuid="58202884478148cc892c360d7a2ee222">tempest-AttachVolumeTestJSON-282088086-project-member</nova:user>
Nov 14 19:46:16 user nova-compute[75205]:         <nova:project uuid="2a60993cb67d417194f8f9ef73e84550">tempest-AttachVolumeTestJSON-282088086</nova:project>
Nov 14 19:46:16 user nova-compute[75205]:       </nova:owner>
Nov 14 19:46:16 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:46:16 user nova-compute[75205]:       <nova:ports>
Nov 14 19:46:16 user nova-compute[75205]:         <nova:port uuid="5072b761-791b-4a1c-bec4-ca316dcf322b">
Nov 14 19:46:16 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 19:46:16 user nova-compute[75205]:         </nova:port>
Nov 14 19:46:16 user nova-compute[75205]:       </nova:ports>
Nov 14 19:46:16 user nova-compute[75205]:     </nova:instance>
Nov 14 19:46:16 user nova-compute[75205]:   </metadata>
Nov 14 19:46:16 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:46:16 user nova-compute[75205]:     <system>
Nov 14 19:46:16 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:46:16 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:46:16 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:46:16 user nova-compute[75205]:       <entry name="serial">61e2b2db-66c5-4489-a6ce-1be4d38c556c</entry>
Nov 14 19:46:16 user nova-compute[75205]:       <entry name="uuid">61e2b2db-66c5-4489-a6ce-1be4d38c556c</entry>
Nov 14 19:46:16 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:46:16 user nova-compute[75205]:     </system>
Nov 14 19:46:16 user nova-compute[75205]:   </sysinfo>
Nov 14 19:46:16 user nova-compute[75205]:   <os>
Nov 14 19:46:16 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:46:16 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:46:16 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:46:16 user nova-compute[75205]:   </os>
Nov 14 19:46:16 user nova-compute[75205]:   <features>
Nov 14 19:46:16 user nova-compute[75205]:     <acpi/>
Nov 14 19:46:16 user nova-compute[75205]:     <apic/>
Nov 14 19:46:16 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:46:16 user nova-compute[75205]:   </features>
Nov 14 19:46:16 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:46:16 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:46:16 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:46:16 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:46:16 user nova-compute[75205]:   </clock>
Nov 14 19:46:16 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:46:16 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:46:16 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:46:16 user nova-compute[75205]:   </cpu>
Nov 14 19:46:16 user nova-compute[75205]:   <devices>
Nov 14 19:46:16 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:46:16 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:46:16 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk"/>
Nov 14 19:46:16 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:46:16 user nova-compute[75205]:     </disk>
Nov 14 19:46:16 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:46:16 user nova-compute[75205]:       <mac address="fa:16:3e:68:b5:9c"/>
Nov 14 19:46:16 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:46:16 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:46:16 user nova-compute[75205]:       <target dev="tap5072b761-79"/>
Nov 14 19:46:16 user nova-compute[75205]:     </interface>
Nov 14 19:46:16 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:46:16 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/console.log" append="off"/>
Nov 14 19:46:16 user nova-compute[75205]:     </serial>
Nov 14 19:46:16 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:46:16 user nova-compute[75205]:     <video>
Nov 14 19:46:16 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:46:16 user nova-compute[75205]:     </video>
Nov 14 19:46:16 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:46:16 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:46:16 user nova-compute[75205]:     </rng>
Nov 14 19:46:16 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:46:16 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:46:16 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:46:16 user nova-compute[75205]:     </memballoon>
Nov 14 19:46:16 user nova-compute[75205]:   </devices>
Nov 14 19:46:16 user nova-compute[75205]: </domain>
Nov 14 19:46:16 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-405787254',display_name='tempest-AttachVolumeTestJSON-server-405787254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-405787254',id=52,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN35V3dim2V/Bf7xM7/gVV1A8XdX+OsrCHsO2AHNl7ihPtswqE8P1QCHuWkTcpKuOJahqPIJJTsyGB5L9KHplODHOpSSsyEJMmjdyGsv0Mqsf7EFvL0H0TcBsR66ip2AuQ==',key_name='tempest-keypair-1825129783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-h7li7sra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=61e2b2db-66c5-4489-a6ce-1be4d38c556c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=5072b761-791b-4a1c-bec4-ca316dcf322b,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5072b761-79') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG os_vif [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=5072b761-791b-4a1c-bec4-ca316dcf322b,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5072b761-79') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4200923c-7339-5454-9d3f-936117a2d20d', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5072b761-79, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5072b761-79, col_values=(('qos', UUID('ef6472ed-96da-48f5-a13e-6c8241317fe7')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5072b761-79, col_values=(('external_ids', {'iface-id': '5072b761-791b-4a1c-bec4-ca316dcf322b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:b5:9c', 'vm-uuid': '61e2b2db-66c5-4489-a6ce-1be4d38c556c'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:16 user nova-compute[75205]: INFO os_vif [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=5072b761-791b-4a1c-bec4-ca316dcf322b,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5072b761-79')
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No VIF found with MAC fa:16:3e:68:b5:9c, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.neutron [req-e7e6814a-243e-4fc8-a0dd-0e8b6ac108bd req-cc203aa4-d259-4625-b5ce-e1e918a30d17 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Updated VIF entry in instance network info cache for port 5072b761-791b-4a1c-bec4-ca316dcf322b. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG nova.network.neutron [req-e7e6814a-243e-4fc8-a0dd-0e8b6ac108bd req-cc203aa4-d259-4625-b5ce-e1e918a30d17 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Updating instance_info_cache with network_info: [{"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:46:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-e7e6814a-243e-4fc8-a0dd-0e8b6ac108bd req-cc203aa4-d259-4625-b5ce-e1e918a30d17 service nova] Releasing lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:46:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-2d2c7dcc-2e05-469d-aea2-2494cd3cb276 req-65ee7c3c-fc71-4277-9e64-94bea4cc7e99 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received event network-vif-plugged-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:46:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2d2c7dcc-2e05-469d-aea2-2494cd3cb276 req-65ee7c3c-fc71-4277-9e64-94bea4cc7e99 service nova] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2d2c7dcc-2e05-469d-aea2-2494cd3cb276 req-65ee7c3c-fc71-4277-9e64-94bea4cc7e99 service nova] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-2d2c7dcc-2e05-469d-aea2-2494cd3cb276 req-65ee7c3c-fc71-4277-9e64-94bea4cc7e99 service nova] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-2d2c7dcc-2e05-469d-aea2-2494cd3cb276 req-65ee7c3c-fc71-4277-9e64-94bea4cc7e99 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] No waiting events found dispatching network-vif-plugged-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:46:18 user nova-compute[75205]: WARNING nova.compute.manager [req-2d2c7dcc-2e05-469d-aea2-2494cd3cb276 req-65ee7c3c-fc71-4277-9e64-94bea4cc7e99 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received unexpected event network-vif-plugged-5072b761-791b-4a1c-bec4-ca316dcf322b for instance with vm_state building and task_state spawning.
Nov 14 19:46:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:18 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:46:20 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Instance spawned successfully.
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:46:20 user nova-compute[75205]: INFO nova.compute.manager [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:46:20 user nova-compute[75205]: INFO nova.compute.manager [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Took 5.92 seconds to build instance.
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-491da07c-b188-4711-ab43-0976cb33f76a req-c615419a-7c58-42af-af12-055f024311c4 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received event network-vif-plugged-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-491da07c-b188-4711-ab43-0976cb33f76a req-c615419a-7c58-42af-af12-055f024311c4 service nova] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-491da07c-b188-4711-ab43-0976cb33f76a req-c615419a-7c58-42af-af12-055f024311c4 service nova] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-491da07c-b188-4711-ab43-0976cb33f76a req-c615419a-7c58-42af-af12-055f024311c4 service nova] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:20 user nova-compute[75205]: DEBUG nova.compute.manager [req-491da07c-b188-4711-ab43-0976cb33f76a req-c615419a-7c58-42af-af12-055f024311c4 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] No waiting events found dispatching network-vif-plugged-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:46:20 user nova-compute[75205]: WARNING nova.compute.manager [req-491da07c-b188-4711-ab43-0976cb33f76a req-c615419a-7c58-42af-af12-055f024311c4 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received unexpected event network-vif-plugged-5072b761-791b-4a1c-bec4-ca316dcf322b for instance with vm_state active and task_state None.
Nov 14 19:46:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5777c1e3-e38a-438b-adce-6b2abebaa315 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.026s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:46:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:48 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:46:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:48 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:48 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:46:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:48 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:49 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:46:49 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:46:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=24.97442626953125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance bb6adf57-89a2-4b72-8520-504007ba66ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:46:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:51 user nova-compute[75205]: DEBUG nova.objects.instance [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'flavor' on Instance uuid bb6adf57-89a2-4b72-8520-504007ba66ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:46:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:46:52 user nova-compute[75205]: INFO nova.compute.manager [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Attaching volume 7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 to /dev/vdb
Nov 14 19:46:52 user nova-compute[75205]: DEBUG os_brick.utils [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82eb6ee-c2ce-4e5c-8126-59fd3b48e9ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1020a56-8328-489f-a65c-f62c8f8059c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23d5423-c1b1-41b4-a5d7-1771d7ffeb31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb56017-5280-4309-b7de-be72a6e922ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:46:52 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:46:52 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdbe631-c256-496f-b625-b6262b4f608f]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG os_brick.utils [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating existing volume attachment record: 99e2d3ab-580b-457a-8c06-07b314d9005c {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:46:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:53 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:46:53 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:46:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUnxJbrC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:46:56 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:46:56 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:46:56 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9433487-0496-46d9-aca6-40233626bcf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:46:56 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be66e1d-c277-4d15-8bef-c3b06dfb58de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9] added
Nov 14 19:46:56 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c065ea98-defc-4943-9f4b-a5875c155a6b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06eefa8-a0b8-46bc-88a1-93fc5b44d8b4]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUnxJbrC {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUnxJbrC" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea986f6-006d-46fe-ba15-d01e370dc3ad]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUnxJbrC'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35bb9d0-2b40-4d52-8868-2dd40ee1351e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d0d5eb-eb41-4be8-99df-fff8af59c6f4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:46:56 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:46:56 user nova-compute[75205]:  {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:46:56 user nova-compute[75205]: WARNING os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 19:46:56 user nova-compute[75205]: 
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c599c5-5a51-4fed-9e37-9ff8e0bac171]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9, portal: 172.16.0.220,3260]
Nov 14 19:46:56 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9, portal: 172.16.0.220,3260] successful.
Nov 14 19:46:56 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[52239571-3fcb-4a57-bfd3-d0ff7c1bcb2e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1800679d-4a78-4254-b493-51720b0adbc9]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:46:56 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:46:56 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cb2550-da8d-4c9d-8431-bebf4d7131e0]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:46:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUnxJbrC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:46:57 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:46:57 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:46:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:46:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23437396539366663', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:46:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437396539366663', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:46:57 user nova-compute[75205]: DEBUG nova.objects.instance [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'flavor' on Instance uuid bb6adf57-89a2-4b72-8520-504007ba66ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:46:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:46:57 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:46:57 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:46:57 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:46:57 user nova-compute[75205]:   <serial>7249e7ab-a2bf-40ed-9bd9-492f44bf55d9</serial>
Nov 14 19:46:57 user nova-compute[75205]: </disk>
Nov 14 19:46:57 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:46:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:46:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:46:58 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] No VIF found with MAC fa:16:3e:6e:71:47, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:46:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-770f938b-aeaf-452e-94ca-3f440e483f1b tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.288s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:46:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:47:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:47:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-d72f5b38-fe22-45e6-a2d1-443ee810509e req-2c66acce-c619-496c-8134-39ada17a5d9d service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-changed-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:47:00 user nova-compute[75205]: DEBUG nova.compute.manager [req-d72f5b38-fe22-45e6-a2d1-443ee810509e req-2c66acce-c619-496c-8134-39ada17a5d9d service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Refreshing instance network info cache due to event network-changed-619e7fe6-d7ae-413b-9d12-92298997364b. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:47:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d72f5b38-fe22-45e6-a2d1-443ee810509e req-2c66acce-c619-496c-8134-39ada17a5d9d service nova] Acquiring lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:47:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d72f5b38-fe22-45e6-a2d1-443ee810509e req-2c66acce-c619-496c-8134-39ada17a5d9d service nova] Acquired lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:47:00 user nova-compute[75205]: DEBUG nova.network.neutron [req-d72f5b38-fe22-45e6-a2d1-443ee810509e req-2c66acce-c619-496c-8134-39ada17a5d9d service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Refreshing network info cache for port 619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG nova.network.neutron [req-d72f5b38-fe22-45e6-a2d1-443ee810509e req-2c66acce-c619-496c-8134-39ada17a5d9d service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updated VIF entry in instance network info cache for port 619e7fe6-d7ae-413b-9d12-92298997364b. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG nova.network.neutron [req-d72f5b38-fe22-45e6-a2d1-443ee810509e req-2c66acce-c619-496c-8134-39ada17a5d9d service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d72f5b38-fe22-45e6-a2d1-443ee810509e req-2c66acce-c619-496c-8134-39ada17a5d9d service nova] Releasing lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid bb6adf57-89a2-4b72-8520-504007ba66ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:47:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:47:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:47:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:47:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-5401b131-7cd3-478e-88d6-577ce1b7b5ce req-d9c60fba-e171-4f14-97df-09b7b653f9ff service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-changed-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:47:03 user nova-compute[75205]: DEBUG nova.compute.manager [req-5401b131-7cd3-478e-88d6-577ce1b7b5ce req-d9c60fba-e171-4f14-97df-09b7b653f9ff service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Refreshing instance network info cache due to event network-changed-619e7fe6-d7ae-413b-9d12-92298997364b. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:47:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5401b131-7cd3-478e-88d6-577ce1b7b5ce req-d9c60fba-e171-4f14-97df-09b7b653f9ff service nova] Acquiring lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:47:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5401b131-7cd3-478e-88d6-577ce1b7b5ce req-d9c60fba-e171-4f14-97df-09b7b653f9ff service nova] Acquired lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:47:03 user nova-compute[75205]: DEBUG nova.network.neutron [req-5401b131-7cd3-478e-88d6-577ce1b7b5ce req-d9c60fba-e171-4f14-97df-09b7b653f9ff service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Refreshing network info cache for port 619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:47:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:47:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:47:04 user nova-compute[75205]: INFO nova.compute.manager [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Rebooting instance
Nov 14 19:47:04 user nova-compute[75205]: DEBUG nova.network.neutron [req-5401b131-7cd3-478e-88d6-577ce1b7b5ce req-d9c60fba-e171-4f14-97df-09b7b653f9ff service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updated VIF entry in instance network info cache for port 619e7fe6-d7ae-413b-9d12-92298997364b. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:47:04 user nova-compute[75205]: DEBUG nova.network.neutron [req-5401b131-7cd3-478e-88d6-577ce1b7b5ce req-d9c60fba-e171-4f14-97df-09b7b653f9ff service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:47:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-5401b131-7cd3-478e-88d6-577ce1b7b5ce req-d9c60fba-e171-4f14-97df-09b7b653f9ff service nova] Releasing lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:47:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:47:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquired lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:47:04 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:47:04 user nova-compute[75205]: DEBUG nova.network.neutron [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:47:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Releasing lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:47:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:47:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-6d4852bd-2fd5-4105-ac29-4dc8edee1847 req-c8067ac9-27d2-4550-8517-f1edcc02370b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-vif-unplugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:47:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6d4852bd-2fd5-4105-ac29-4dc8edee1847 req-c8067ac9-27d2-4550-8517-f1edcc02370b service nova] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:47:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6d4852bd-2fd5-4105-ac29-4dc8edee1847 req-c8067ac9-27d2-4550-8517-f1edcc02370b service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:47:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-6d4852bd-2fd5-4105-ac29-4dc8edee1847 req-c8067ac9-27d2-4550-8517-f1edcc02370b service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:47:07 user nova-compute[75205]: DEBUG nova.compute.manager [req-6d4852bd-2fd5-4105-ac29-4dc8edee1847 req-c8067ac9-27d2-4550-8517-f1edcc02370b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] No waiting events found dispatching network-vif-unplugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:47:07 user nova-compute[75205]: WARNING nova.compute.manager [req-6d4852bd-2fd5-4105-ac29-4dc8edee1847 req-c8067ac9-27d2-4550-8517-f1edcc02370b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received unexpected event network-vif-unplugged-619e7fe6-d7ae-413b-9d12-92298997364b for instance with vm_state active and task_state reboot_started.
Nov 14 19:47:07 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Instance shutdown successfully.
Nov 14 19:47:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:08 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb6eb60b-7f84-47c3-801a-af4f6742e7ee req-4a08eb88-2827-4619-8510-d885a0ac138b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:47:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb6eb60b-7f84-47c3-801a-af4f6742e7ee req-4a08eb88-2827-4619-8510-d885a0ac138b service nova] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:47:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb6eb60b-7f84-47c3-801a-af4f6742e7ee req-4a08eb88-2827-4619-8510-d885a0ac138b service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:47:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-cb6eb60b-7f84-47c3-801a-af4f6742e7ee req-4a08eb88-2827-4619-8510-d885a0ac138b service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:47:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-cb6eb60b-7f84-47c3-801a-af4f6742e7ee req-4a08eb88-2827-4619-8510-d885a0ac138b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] No waiting events found dispatching network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:47:09 user nova-compute[75205]: WARNING nova.compute.manager [req-cb6eb60b-7f84-47c3-801a-af4f6742e7ee req-4a08eb88-2827-4619-8510-d885a0ac138b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received unexpected event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b for instance with vm_state active and task_state reboot_started.
Nov 14 19:47:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:11 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Instance running successfully.
Nov 14 19:47:11 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Instance soft rebooted successfully.
Nov 14 19:47:11 user nova-compute[75205]: DEBUG nova.compute.manager [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:47:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:47:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:47:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:47:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:47:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] No waiting events found dispatching network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:47:11 user nova-compute[75205]: WARNING nova.compute.manager [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received unexpected event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b for instance with vm_state active and task_state reboot_started.
Nov 14 19:47:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:47:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:47:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:47:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:47:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] No waiting events found dispatching network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:47:11 user nova-compute[75205]: WARNING nova.compute.manager [req-af920d39-932c-4fcf-8487-911441c953c2 req-e6ca89ac-bb2d-4b20-b56c-26aa32b36cd2 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received unexpected event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b for instance with vm_state active and task_state reboot_started.
Nov 14 19:47:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a3449f5f-46cd-46a1-96b3-a240b919e2a0 tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.096s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:47:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:14 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:47:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:49 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:47:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:47:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:47:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:47:49 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:47:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:47:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:47:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:47:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:47:49 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:47:50 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:47:50 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:47:50 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8860MB free_disk=24.972396850585938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance bb6adf57-89a2-4b72-8520-504007ba66ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:47:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:47:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:47:53 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:47:53 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:47:53 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:47:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:47:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:47:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:47:59 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:48:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:48:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:02 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:48:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:48:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:48:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:48:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:48:03 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Updating instance_info_cache with network_info: [{"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:48:03 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:48:03 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:48:04 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:48:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-f9eb5f8a-7fab-492f-a8ff-dff909a296c2 req-3f1d4d20-ae76-4e2d-8bba-47a2ad381477 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received event network-changed-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:48:05 user nova-compute[75205]: DEBUG nova.compute.manager [req-f9eb5f8a-7fab-492f-a8ff-dff909a296c2 req-3f1d4d20-ae76-4e2d-8bba-47a2ad381477 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Refreshing instance network info cache due to event network-changed-5072b761-791b-4a1c-bec4-ca316dcf322b. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:48:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f9eb5f8a-7fab-492f-a8ff-dff909a296c2 req-3f1d4d20-ae76-4e2d-8bba-47a2ad381477 service nova] Acquiring lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:48:05 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f9eb5f8a-7fab-492f-a8ff-dff909a296c2 req-3f1d4d20-ae76-4e2d-8bba-47a2ad381477 service nova] Acquired lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:48:05 user nova-compute[75205]: DEBUG nova.network.neutron [req-f9eb5f8a-7fab-492f-a8ff-dff909a296c2 req-3f1d4d20-ae76-4e2d-8bba-47a2ad381477 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Refreshing network info cache for port 5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:48:06 user nova-compute[75205]: DEBUG nova.network.neutron [req-f9eb5f8a-7fab-492f-a8ff-dff909a296c2 req-3f1d4d20-ae76-4e2d-8bba-47a2ad381477 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Updated VIF entry in instance network info cache for port 5072b761-791b-4a1c-bec4-ca316dcf322b. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:48:06 user nova-compute[75205]: DEBUG nova.network.neutron [req-f9eb5f8a-7fab-492f-a8ff-dff909a296c2 req-3f1d4d20-ae76-4e2d-8bba-47a2ad381477 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Updating instance_info_cache with network_info: [{"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:48:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-f9eb5f8a-7fab-492f-a8ff-dff909a296c2 req-3f1d4d20-ae76-4e2d-8bba-47a2ad381477 service nova] Releasing lock "refresh_cache-61e2b2db-66c5-4489-a6ce-1be4d38c556c" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:48:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:07 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 61e2b2db-66c5-4489-a6ce-1be4d38c556c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:48:08 user nova-compute[75205]: INFO nova.compute.manager [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Attaching volume e1f5d925-24da-4b73-887d-aefdd90a795a to /dev/vdb
Nov 14 19:48:08 user nova-compute[75205]: DEBUG os_brick.utils [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d8296e-786a-40a6-945c-e39e3ec44836]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d453ec-d1a7-4a81-bf5b-c50b7082add6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[793c57ea-d84c-4e80-9298-77ffbfad0bda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7392dac1-38fc-40b6-8323-38b8ebee17bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:48:08 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:48:08 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a82fb0-1569-4677-b5ce-04e2e5bc1dae]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG os_brick.utils [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:48:08 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Updating existing volume attachment record: 6e6c324c-2354-4299-9227-d734a12c0871 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:48:11 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBbuegJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:48:12 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:48:12 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:48:12 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bfd12a-43e5-4a39-9b31-fa0029205293]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:48:12 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d77bbf-6366-4a2e-96e0-3d52f50e32cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a] added
Nov 14 19:48:12 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7962e865-6802-462b-91e3-953c2a537a01]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[61021d95-dfe7-40d3-aed3-38a5e98f72e3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBbuegJM {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBbuegJM" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa73745-57bf-4359-bcaf-ea937243e5e2]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IBbuegJM'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2d35ae-fd81-4c97-af80-4991a8ac1e7b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[05288b0a-149a-4912-9755-bfa18c51bdc9]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:48:12 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:48:12 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[612f4996-eb95-43c6-8b7c-d5373132f772]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a, portal: 172.16.0.220,3260]
Nov 14 19:48:12 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a, portal: 172.16.0.220,3260] successful.
Nov 14 19:48:12 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:12 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd43f2-68a2-4e71-90a7-b667750a050e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[27653c68-7984-4a05-898d-c2da9b279a56]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:48:13 user nova-compute[75205]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)
Nov 14 19:48:13 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:48:13 user nova-compute[75205]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)
Nov 14 19:48:13 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9291dd3-051e-4c12-a3ac-a11715a0afaf]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:13 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBbuegJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26630653232336131', 'path': '/dev/sdc'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630653232336131', 'path': '/dev/sdc'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG nova.objects.instance [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 61e2b2db-66c5-4489-a6ce-1be4d38c556c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:48:14 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:48:14 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:48:14 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:48:14 user nova-compute[75205]:   <serial>e1f5d925-24da-4b73-887d-aefdd90a795a</serial>
Nov 14 19:48:14 user nova-compute[75205]: </disk>
Nov 14 19:48:14 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No VIF found with MAC fa:16:3e:68:b5:9c, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:48:14 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-3ad160b0-4256-4517-9ca7-6b2cbb1092c3 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.275s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG nova.objects.instance [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 61e2b2db-66c5-4489-a6ce-1be4d38c556c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:48:16 user nova-compute[75205]: INFO nova.compute.manager [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Attaching volume 4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 to /dev/vdc
Nov 14 19:48:16 user nova-compute[75205]: DEBUG os_brick.utils [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[546002a6-5811-4bae-b819-e70c57a437ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed93205-6e4a-45ae-a117-6406c0a55c0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[71368fc6-ffc2-41c8-ab02-856c43df17c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f60588-5c9d-45f5-a151-7e538b3c99f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:48:16 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:48:16 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daff3b4-2c3c-472b-a93d-771df1bee5a2]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG os_brick.utils [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:48:16 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Updating existing volume attachment record: 8b966efd-93db-4477-811d-bfbeac96530c {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLzUoKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:48:21 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:48:21 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:48:21 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42836ed-fd0b-4d2f-a206-367cb49b6e05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:48:21 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f240de-1481-4aa5-9054-890897b9693f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0] added
Nov 14 19:48:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a48537-ee4a-4b4f-bbe9-bbf70408cae9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c5db10-6ffe-42fa-a8e6-9e53573622d3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shLzUoKZ {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shLzUoKZ" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[59286347-bf50-43cf-aa0d-02633c2f62a7]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'shLzUoKZ'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5387e26e-11eb-49c7-9471-5fe3b631f174]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b726cd8-4305-40da-a631-17194029967e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:48:21 user nova-compute[75205]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)
Nov 14 19:48:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:48:21 user nova-compute[75205]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)
Nov 14 19:48:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[269a037f-67e1-4796-8048-d39c7d0ae320]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0, portal: 172.16.0.220,3260]
Nov 14 19:48:21 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0, portal: 172.16.0.220,3260] successful.
Nov 14 19:48:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee290f5-ab59-4662-af30-c5cf56e7dfcc]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a146b12-8e55-43d3-b11b-7ef6014834d8]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:48:21 user nova-compute[75205]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)
Nov 14 19:48:21 user nova-compute[75205]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 (non-flash)
Nov 14 19:48:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:48:21 user nova-compute[75205]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)
Nov 14 19:48:21 user nova-compute[75205]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 (non-flash)
Nov 14 19:48:21 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] HCTL ('35', '-', '-', 0) found on session 63 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfe46e6-81cc-4b02-be65-6852172be999]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching for a device in session 63 and hctl ['35', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:48:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Searching for a device in session 63 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLzUoKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26131303261623266', 'path': '/dev/sdd'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131303261623266', 'path': '/dev/sdd'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG nova.objects.instance [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 61e2b2db-66c5-4489-a6ce-1be4d38c556c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:48:22 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:48:22 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:48:22 user nova-compute[75205]:   <target dev="vdc" bus="virtio"/>
Nov 14 19:48:22 user nova-compute[75205]:   <serial>4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0</serial>
Nov 14 19:48:22 user nova-compute[75205]: </disk>
Nov 14 19:48:22 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] No VIF found with MAC fa:16:3e:68:b5:9c, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:48:22 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-113c1925-0d92-4f7f-bed8-493a2157c3e0 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.338s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:48:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:48:23 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:48:23 user nova-compute[75205]: INFO nova.compute.manager [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Detaching volume e1f5d925-24da-4b73-887d-aefdd90a795a
Nov 14 19:48:23 user nova-compute[75205]: INFO nova.virt.block_device [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Attempting to driver detach volume e1f5d925-24da-4b73-887d-aefdd90a795a from mountpoint /dev/vdb
Nov 14 19:48:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Attempting to detach device vdb from instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:48:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:48:23 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:48:23 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:48:23 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:48:23 user nova-compute[75205]:   <serial>e1f5d925-24da-4b73-887d-aefdd90a795a</serial>
Nov 14 19:48:23 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:48:23 user nova-compute[75205]: </disk>
Nov 14 19:48:23 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:48:23 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully detached device vdb from instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c from the persistent domain config.
Nov 14 19:48:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:48:23 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:48:23 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:48:23 user nova-compute[75205]:   <source dev="/dev/sdc"/>
Nov 14 19:48:23 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:48:23 user nova-compute[75205]:   <serial>e1f5d925-24da-4b73-887d-aefdd90a795a</serial>
Nov 14 19:48:23 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:48:23 user nova-compute[75205]: </disk>
Nov 14 19:48:23 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:48:24 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:48:26 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:48:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:48:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:48:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:48:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:41 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:44 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c is timed out.
Nov 14 19:48:44 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully detached device vdb from instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c from the live domain config.
Nov 14 19:48:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBbuegJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:48:44 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd139b91-c3b9-47c0-af02-e39bc0c03eca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:48:44 user nova-compute[75205]: No targets found.
Nov 14 19:48:44 user nova-compute[75205]: iSNS:
Nov 14 19:48:44 user nova-compute[75205]: No targets found.
Nov 14 19:48:44 user nova-compute[75205]: STATIC:
Nov 14 19:48:44 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9
Nov 14 19:48:44 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:48:44 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:48:44 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a
Nov 14 19:48:44 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:48:44 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:48:44 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0
Nov 14 19:48:44 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:48:44 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:48:44 user nova-compute[75205]: FIRMWARE:
Nov 14 19:48:44 user nova-compute[75205]: No targets found.
Nov 14 19:48:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:48:44 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:48:44 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f9d945-ae3a-4b35-ba8c-acbc9f6c5e98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc26b39-910f-4a26-9214-71bf42ba6d62]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:48:44 user nova-compute[75205]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)
Nov 14 19:48:44 user nova-compute[75205]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 (non-flash)
Nov 14 19:48:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:48:44 user nova-compute[75205]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a (non-flash)
Nov 14 19:48:44 user nova-compute[75205]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 (non-flash)
Nov 14 19:48:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb74618430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a'): ({'sdc'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Removing single pathed devices sdc {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dff214f-7f08-49a1-8e92-397dc1c0835b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[913c87bd-0eb5-4840-b605-99f602e6156f]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flushing IO for device /dev/sdc {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d19b4f1-104c-4a39-bc84-ad71023ddeaf]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5167b2-9bbc-43db-a5e7-8b41077f8373]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] SCSI volumes sdc have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ccf398-07ea-41ef-b4bf-1a5ae11e735d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7260fe3b-239c-49f8-a3bd-d2ed438435bd]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a, portal: 172.16.0.220,3260]
Nov 14 19:48:44 user nova-compute[75205]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a, portal: 172.16.0.220,3260] successful.
Nov 14 19:48:44 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f5d925-24da-4b73-887d-aefdd90a795a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[42519b0f-5792-4fc2-8631-d1973f7f05c9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== disconnect_volume: return (300ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:48:44 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:48:45 user nova-compute[75205]: DEBUG nova.objects.instance [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 61e2b2db-66c5-4489-a6ce-1be4d38c556c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:48:45 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-668bb766-2ed8-4d96-98f2-9b47b5daf1c6 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.587s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:48:46 user nova-compute[75205]: INFO nova.compute.manager [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Detaching volume 4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0
Nov 14 19:48:46 user nova-compute[75205]: INFO nova.virt.block_device [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Attempting to driver detach volume 4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 from mountpoint /dev/vdc
Nov 14 19:48:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Attempting to detach device vdc from instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:48:46 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:48:46 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:48:46 user nova-compute[75205]:   <target dev="vdc" bus="virtio"/>
Nov 14 19:48:46 user nova-compute[75205]:   <serial>4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0</serial>
Nov 14 19:48:46 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 19:48:46 user nova-compute[75205]: </disk>
Nov 14 19:48:46 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:48:46 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully detached device vdc from instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c from the persistent domain config.
Nov 14 19:48:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:48:46 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:48:46 user nova-compute[75205]:   <source dev="/dev/sdd"/>
Nov 14 19:48:46 user nova-compute[75205]:   <target dev="vdc" bus="virtio"/>
Nov 14 19:48:46 user nova-compute[75205]:   <serial>4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0</serial>
Nov 14 19:48:46 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 19:48:46 user nova-compute[75205]: </disk>
Nov 14 19:48:46 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:48:46 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:50 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:48:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:48:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:48:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:48:50 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:48:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:50 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75205) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 19:48:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:48:51 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:48:51 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8813MB free_disk=24.970848083496094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance bb6adf57-89a2-4b72-8520-504007ba66ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:48:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:48:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:48:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:48:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:48:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-d53073a1-3bab-41ad-8107-da863f59798e req-7576e6c1-c48c-495a-a1f6-bc91103d69fa service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-changed-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:48:55 user nova-compute[75205]: DEBUG nova.compute.manager [req-d53073a1-3bab-41ad-8107-da863f59798e req-7576e6c1-c48c-495a-a1f6-bc91103d69fa service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Refreshing instance network info cache due to event network-changed-619e7fe6-d7ae-413b-9d12-92298997364b. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:48:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d53073a1-3bab-41ad-8107-da863f59798e req-7576e6c1-c48c-495a-a1f6-bc91103d69fa service nova] Acquiring lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:48:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d53073a1-3bab-41ad-8107-da863f59798e req-7576e6c1-c48c-495a-a1f6-bc91103d69fa service nova] Acquired lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:48:55 user nova-compute[75205]: DEBUG nova.network.neutron [req-d53073a1-3bab-41ad-8107-da863f59798e req-7576e6c1-c48c-495a-a1f6-bc91103d69fa service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Refreshing network info cache for port 619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:48:56 user nova-compute[75205]: DEBUG nova.network.neutron [req-d53073a1-3bab-41ad-8107-da863f59798e req-7576e6c1-c48c-495a-a1f6-bc91103d69fa service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updated VIF entry in instance network info cache for port 619e7fe6-d7ae-413b-9d12-92298997364b. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:48:56 user nova-compute[75205]: DEBUG nova.network.neutron [req-d53073a1-3bab-41ad-8107-da863f59798e req-7576e6c1-c48c-495a-a1f6-bc91103d69fa service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:48:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-d53073a1-3bab-41ad-8107-da863f59798e req-7576e6c1-c48c-495a-a1f6-bc91103d69fa service nova] Releasing lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:48:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:48:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:48:56 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:56 user nova-compute[75205]: INFO nova.compute.manager [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Detaching volume 7249e7ab-a2bf-40ed-9bd9-492f44bf55d9
Nov 14 19:48:56 user nova-compute[75205]: INFO nova.virt.block_device [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Attempting to driver detach volume 7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 from mountpoint /dev/vdb
Nov 14 19:48:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Attempting to detach device vdb from instance bb6adf57-89a2-4b72-8520-504007ba66ca from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:48:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:48:56 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:48:56 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:48:56 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:48:56 user nova-compute[75205]:   <serial>7249e7ab-a2bf-40ed-9bd9-492f44bf55d9</serial>
Nov 14 19:48:56 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:48:56 user nova-compute[75205]: </disk>
Nov 14 19:48:56 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:48:56 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Successfully detached device vdb from instance bb6adf57-89a2-4b72-8520-504007ba66ca from the persistent domain config.
Nov 14 19:48:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb6adf57-89a2-4b72-8520-504007ba66ca from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:48:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:48:56 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:48:56 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:48:56 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:48:56 user nova-compute[75205]:   <serial>7249e7ab-a2bf-40ed-9bd9-492f44bf55d9</serial>
Nov 14 19:48:56 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:48:56 user nova-compute[75205]: </disk>
Nov 14 19:48:56 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:48:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb6adf57-89a2-4b72-8520-504007ba66ca {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:48:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:48:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-be42bb08-b072-4e4f-8e51-e17929c74e29 req-6b5de17e-5acf-4ebd-bdab-69423eea9e6b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-changed-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:48:57 user nova-compute[75205]: DEBUG nova.compute.manager [req-be42bb08-b072-4e4f-8e51-e17929c74e29 req-6b5de17e-5acf-4ebd-bdab-69423eea9e6b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Refreshing instance network info cache due to event network-changed-619e7fe6-d7ae-413b-9d12-92298997364b. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:48:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-be42bb08-b072-4e4f-8e51-e17929c74e29 req-6b5de17e-5acf-4ebd-bdab-69423eea9e6b service nova] Acquiring lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:48:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-be42bb08-b072-4e4f-8e51-e17929c74e29 req-6b5de17e-5acf-4ebd-bdab-69423eea9e6b service nova] Acquired lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:48:57 user nova-compute[75205]: DEBUG nova.network.neutron [req-be42bb08-b072-4e4f-8e51-e17929c74e29 req-6b5de17e-5acf-4ebd-bdab-69423eea9e6b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Refreshing network info cache for port 619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:48:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-be42bb08-b072-4e4f-8e51-e17929c74e29 req-6b5de17e-5acf-4ebd-bdab-69423eea9e6b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updated VIF entry in instance network info cache for port 619e7fe6-d7ae-413b-9d12-92298997364b. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:48:58 user nova-compute[75205]: DEBUG nova.network.neutron [req-be42bb08-b072-4e4f-8e51-e17929c74e29 req-6b5de17e-5acf-4ebd-bdab-69423eea9e6b service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:48:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-be42bb08-b072-4e4f-8e51-e17929c74e29 req-6b5de17e-5acf-4ebd-bdab-69423eea9e6b service nova] Releasing lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:48:59 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:48:59 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:49:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:49:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:49:01 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:02 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:49:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:49:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:49:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:49:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:49:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:49:02 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid bb6adf57-89a2-4b72-8520-504007ba66ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:49:02 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [{"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:49:02 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-bb6adf57-89a2-4b72-8520-504007ba66ca" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:49:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:49:04 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:49:06 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c is timed out.
Nov 14 19:49:06 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully detached device vdc from instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c from the live domain config.
Nov 14 19:49:06 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLzUoKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:49:06 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[115817f1-bed7-43dd-8825-0d728d120185]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:49:06 user nova-compute[75205]: No targets found.
Nov 14 19:49:06 user nova-compute[75205]: iSNS:
Nov 14 19:49:06 user nova-compute[75205]: No targets found.
Nov 14 19:49:06 user nova-compute[75205]: STATIC:
Nov 14 19:49:06 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9
Nov 14 19:49:06 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:49:06 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:49:06 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0
Nov 14 19:49:06 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:49:06 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:49:06 user nova-compute[75205]: FIRMWARE:
Nov 14 19:49:06 user nova-compute[75205]: No targets found.
Nov 14 19:49:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:49:06 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:49:06 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b88b0ea-4fd7-4dcb-9861-6cfc4748389f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e160a670-6405-4a60-8935-fd3eb2f2ff31]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:49:06 user nova-compute[75205]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 (non-flash)
Nov 14 19:49:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:49:06 user nova-compute[75205]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 (non-flash)
Nov 14 19:49:06 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb5468dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0'): ({'sdd'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Removing single pathed devices sdd {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e9afad-c2f3-4405-b3ef-34b66aad84a9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffb7298-970f-4b45-8ab7-6733cbdc3cad]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Flushing IO for device /dev/sdd {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3610f5ac-2283-40dc-843f-6c0313f6f793]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b757d55-b7b4-49c1-b2da-858b47e389cb]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] SCSI volumes sdd have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3b6e6c-3abf-4873-b0f6-64688612ec0b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:49:06 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f205aaaf-ab0f-4d1d-a217-cd92a5ae8a98]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0, portal: 172.16.0.220,3260]
Nov 14 19:49:07 user nova-compute[75205]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0, portal: 172.16.0.220,3260] successful.
Nov 14 19:49:07 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a32605c-e4ab-4cf2-9f56-a1dc8dcfdcb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[70917a09-3e94-4e8d-81d0-d3850c236ecf]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] <== disconnect_volume: return (272ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG nova.objects.instance [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'flavor' on Instance uuid 61e2b2db-66c5-4489-a6ce-1be4d38c556c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:49:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-258aa77f-331b-4696-ac2a-f2c467f388e4 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.593s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:09 user nova-compute[75205]: INFO nova.compute.manager [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Terminating instance
Nov 14 19:49:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-4d69c0ea-c175-41c2-b14e-75b404d04a52 req-2d7b80e4-18bd-4bf6-93b5-a79e762bd854 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received event network-vif-unplugged-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4d69c0ea-c175-41c2-b14e-75b404d04a52 req-2d7b80e4-18bd-4bf6-93b5-a79e762bd854 service nova] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4d69c0ea-c175-41c2-b14e-75b404d04a52 req-2d7b80e4-18bd-4bf6-93b5-a79e762bd854 service nova] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-4d69c0ea-c175-41c2-b14e-75b404d04a52 req-2d7b80e4-18bd-4bf6-93b5-a79e762bd854 service nova] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-4d69c0ea-c175-41c2-b14e-75b404d04a52 req-2d7b80e4-18bd-4bf6-93b5-a79e762bd854 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] No waiting events found dispatching network-vif-unplugged-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG nova.compute.manager [req-4d69c0ea-c175-41c2-b14e-75b404d04a52 req-2d7b80e4-18bd-4bf6-93b5-a79e762bd854 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received event network-vif-unplugged-5072b761-791b-4a1c-bec4-ca316dcf322b for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:49:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Instance destroyed successfully.
Nov 14 19:49:09 user nova-compute[75205]: DEBUG nova.objects.instance [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lazy-loading 'resources' on Instance uuid 61e2b2db-66c5-4489-a6ce-1be4d38c556c {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-405787254',display_name='tempest-AttachVolumeTestJSON-server-405787254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-405787254',id=52,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN35V3dim2V/Bf7xM7/gVV1A8XdX+OsrCHsO2AHNl7ihPtswqE8P1QCHuWkTcpKuOJahqPIJJTsyGB5L9KHplODHOpSSsyEJMmjdyGsv0Mqsf7EFvL0H0TcBsR66ip2AuQ==',key_name='tempest-keypair-1825129783',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a60993cb67d417194f8f9ef73e84550',ramdisk_id='',reservation_id='r-h7li7sra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-282088086',owner_user_name='tempest-AttachVolumeTestJSON-282088086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58202884478148cc892c360d7a2ee222',uuid=61e2b2db-66c5-4489-a6ce-1be4d38c556c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converting VIF {"id": "5072b761-791b-4a1c-bec4-ca316dcf322b", "address": "fa:16:3e:68:b5:9c", "network": {"id": "60048de2-e190-43ce-8282-30930c8cc96a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1847242598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a60993cb67d417194f8f9ef73e84550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5072b761-79", "ovs_interfaceid": "5072b761-791b-4a1c-bec4-ca316dcf322b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=5072b761-791b-4a1c-bec4-ca316dcf322b,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5072b761-79') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG os_vif [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=5072b761-791b-4a1c-bec4-ca316dcf322b,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5072b761-79') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5072b761-79, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef6472ed-96da-48f5-a13e-6c8241317fe7) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:49:09 user nova-compute[75205]: INFO os_vif [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=5072b761-791b-4a1c-bec4-ca316dcf322b,network=Network(60048de2-e190-43ce-8282-30930c8cc96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5072b761-79')
Nov 14 19:49:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Deleting instance files /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c_del
Nov 14 19:49:09 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Deletion of /opt/stack/data/nova/instances/61e2b2db-66c5-4489-a6ce-1be4d38c556c_del complete
Nov 14 19:49:09 user nova-compute[75205]: INFO nova.compute.manager [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 19:49:09 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:49:09 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:49:10 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:49:10 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Took 1.07 seconds to deallocate network for instance.
Nov 14 19:49:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-2cab3488-1b90-47e8-88ce-a6a2a9f5c8c9 req-697fff54-9625-433d-9d13-138fc0fe1722 service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received event network-vif-deleted-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:49:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:11 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:49:11 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:49:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:11 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Deleted allocations for instance 61e2b2db-66c5-4489-a6ce-1be4d38c556c
Nov 14 19:49:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-baa0a7e8-b561-4171-becd-80da71406aa5 tempest-AttachVolumeTestJSON-282088086 tempest-AttachVolumeTestJSON-282088086-project-member] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.233s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-469dfe5e-93e7-4638-be75-e4b0b0a6aacb req-2863bc52-aaa5-42f0-9567-36f64c071dda service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received event network-vif-plugged-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:49:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-469dfe5e-93e7-4638-be75-e4b0b0a6aacb req-2863bc52-aaa5-42f0-9567-36f64c071dda service nova] Acquiring lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-469dfe5e-93e7-4638-be75-e4b0b0a6aacb req-2863bc52-aaa5-42f0-9567-36f64c071dda service nova] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:11 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-469dfe5e-93e7-4638-be75-e4b0b0a6aacb req-2863bc52-aaa5-42f0-9567-36f64c071dda service nova] Lock "61e2b2db-66c5-4489-a6ce-1be4d38c556c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:11 user nova-compute[75205]: DEBUG nova.compute.manager [req-469dfe5e-93e7-4638-be75-e4b0b0a6aacb req-2863bc52-aaa5-42f0-9567-36f64c071dda service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] No waiting events found dispatching network-vif-plugged-5072b761-791b-4a1c-bec4-ca316dcf322b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:49:11 user nova-compute[75205]: WARNING nova.compute.manager [req-469dfe5e-93e7-4638-be75-e4b0b0a6aacb req-2863bc52-aaa5-42f0-9567-36f64c071dda service nova] [instance: 61e2b2db-66c5-4489-a6ce-1be4d38c556c] Received unexpected event network-vif-plugged-5072b761-791b-4a1c-bec4-ca316dcf322b for instance with vm_state deleted and task_state None.
Nov 14 19:49:13 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:49:14 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:17 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb6adf57-89a2-4b72-8520-504007ba66ca is timed out.
Nov 14 19:49:17 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Successfully detached device vdb from instance bb6adf57-89a2-4b72-8520-504007ba66ca from the live domain config.
Nov 14 19:49:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUnxJbrC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:49:17 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[682faf53-c4d4-4e7f-9234-4478b08f6e00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:49:17 user nova-compute[75205]: No targets found.
Nov 14 19:49:17 user nova-compute[75205]: iSNS:
Nov 14 19:49:17 user nova-compute[75205]: No targets found.
Nov 14 19:49:17 user nova-compute[75205]: STATIC:
Nov 14 19:49:17 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9
Nov 14 19:49:17 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:49:17 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:49:17 user nova-compute[75205]: FIRMWARE:
Nov 14 19:49:17 user nova-compute[75205]: No targets found.
Nov 14 19:49:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:49:17 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:49:17 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8a8e67-380c-4a93-a8cd-d95844bbd661]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0572871-0f1f-452b-aeb2-c0394609f28a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:49:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 (non-flash)
Nov 14 19:49:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb8c3a7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4d831d-b852-45bb-8a15-85f964e0c9fb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[07468d7c-cb37-480c-9501-f132a3073f76]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f0eb87-8fbe-4b15-bb9b-636b36a80a7b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[079567c4-5861-414e-ac3c-8be9981a4fcd]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[46151fd5-a370-4229-a574-8b53543c2db3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dc7dd0-f556-4ddd-bd0e-245b16af24e1]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9, portal: 172.16.0.220,3260]
Nov 14 19:49:17 user nova-compute[75205]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9, portal: 172.16.0.220,3260] successful.
Nov 14 19:49:17 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7249e7ab-a2bf-40ed-9bd9-492f44bf55d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdcbcc9-27ab-4ffb-a246-f6ff2834b925]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] <== disconnect_volume: return (285ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:49:17 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:49:18 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'flavor' on Instance uuid bb6adf57-89a2-4b72-8520-504007ba66ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:49:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b5519ee8-54b4-4c54-bb10-eab7106c1d3d tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.556s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:24 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:29 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:34 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:39 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:44 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:49 user nova-compute[75205]: INFO nova.compute.manager [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Terminating instance
Nov 14 19:49:49 user nova-compute[75205]: DEBUG nova.compute.manager [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-431fe92c-a08d-43c0-b783-abe286ebc166 req-ab576299-a14c-45e2-ac81-61b2dee5bee7 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-vif-unplugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-431fe92c-a08d-43c0-b783-abe286ebc166 req-ab576299-a14c-45e2-ac81-61b2dee5bee7 service nova] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-431fe92c-a08d-43c0-b783-abe286ebc166 req-ab576299-a14c-45e2-ac81-61b2dee5bee7 service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-431fe92c-a08d-43c0-b783-abe286ebc166 req-ab576299-a14c-45e2-ac81-61b2dee5bee7 service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-431fe92c-a08d-43c0-b783-abe286ebc166 req-ab576299-a14c-45e2-ac81-61b2dee5bee7 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] No waiting events found dispatching network-vif-unplugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG nova.compute.manager [req-431fe92c-a08d-43c0-b783-abe286ebc166 req-ab576299-a14c-45e2-ac81-61b2dee5bee7 service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-vif-unplugged-619e7fe6-d7ae-413b-9d12-92298997364b for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:49:49 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Instance destroyed successfully.
Nov 14 19:49:50 user nova-compute[75205]: DEBUG nova.objects.instance [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lazy-loading 'resources' on Instance uuid bb6adf57-89a2-4b72-8520-504007ba66ca {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1777501226',display_name='tempest-TestMinimumBasicScenario-server-1777501226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1777501226',id=51,image_ref='60412d6d-285d-4b1a-a56c-a41aedd96723',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeaR2rL70mY+QZjywt2NvsEknULlLC3GplsIvEfB7Vz+TOwD9W4rIBLDfn2nyE0UnKwy2/JqZkquEPj2sDoGQe66l4JZBgOeGn7Qc9mJXPukiR4+BEJPm4NDh2Mbr/VSA==',key_name='tempest-TestMinimumBasicScenario-982926860',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:45:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d749beb4f34d2fafa10b4a3cdbab88',ramdisk_id='',reservation_id='r-5mitn57g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='60412d6d-285d-4b1a-a56c-a41aedd96723',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-400789003',owner_user_name='tempest-TestMinimumBasicScenario-400789003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:47:11Z,user_data=None,user_id='949d766f59384494943cb27d5bbc3b95',uuid=bb6adf57-89a2-4b72-8520-504007ba66ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converting VIF {"id": "619e7fe6-d7ae-413b-9d12-92298997364b", "address": "fa:16:3e:6e:71:47", "network": {"id": "52404308-d2d7-427b-8679-2a2a2f30f824", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-52348797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d749beb4f34d2fafa10b4a3cdbab88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619e7fe6-d7", "ovs_interfaceid": "619e7fe6-d7ae-413b-9d12-92298997364b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:71:47,bridge_name='br-int',has_traffic_filtering=True,id=619e7fe6-d7ae-413b-9d12-92298997364b,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619e7fe6-d7') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG os_vif [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:71:47,bridge_name='br-int',has_traffic_filtering=True,id=619e7fe6-d7ae-413b-9d12-92298997364b,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619e7fe6-d7') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap619e7fe6-d7, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16750fb0-6aac-4070-9523-58273076523d) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:50 user nova-compute[75205]: INFO os_vif [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:71:47,bridge_name='br-int',has_traffic_filtering=True,id=619e7fe6-d7ae-413b-9d12-92298997364b,network=Network(52404308-d2d7-427b-8679-2a2a2f30f824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619e7fe6-d7')
Nov 14 19:49:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Deleting instance files /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca_del
Nov 14 19:49:50 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Deletion of /opt/stack/data/nova/instances/bb6adf57-89a2-4b72-8520-504007ba66ca_del complete
Nov 14 19:49:50 user nova-compute[75205]: INFO nova.compute.manager [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 19:49:50 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:49:50 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Took 0.68 seconds to deallocate network for instance.
Nov 14 19:49:50 user nova-compute[75205]: DEBUG nova.compute.manager [req-b977345f-0687-4e8b-a79a-878c1131fd61 req-b4725686-0f5c-486e-b799-7d8f5ee01b3c service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-vif-deleted-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:50 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:51 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:49:51 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:49:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:51 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Deleted allocations for instance bb6adf57-89a2-4b72-8520-504007ba66ca
Nov 14 19:49:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-0efa70a7-6785-4cc4-a015-1d49aac5f4ee tempest-TestMinimumBasicScenario-400789003 tempest-TestMinimumBasicScenario-400789003-project-member] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.973s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-87a5b513-98a7-4baa-9e83-7a7a7e61642c req-0de5d7b4-bc47-44d4-9bbe-c8f0218c413d service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:49:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-87a5b513-98a7-4baa-9e83-7a7a7e61642c req-0de5d7b4-bc47-44d4-9bbe-c8f0218c413d service nova] Acquiring lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-87a5b513-98a7-4baa-9e83-7a7a7e61642c req-0de5d7b4-bc47-44d4-9bbe-c8f0218c413d service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:51 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-87a5b513-98a7-4baa-9e83-7a7a7e61642c req-0de5d7b4-bc47-44d4-9bbe-c8f0218c413d service nova] Lock "bb6adf57-89a2-4b72-8520-504007ba66ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:51 user nova-compute[75205]: DEBUG nova.compute.manager [req-87a5b513-98a7-4baa-9e83-7a7a7e61642c req-0de5d7b4-bc47-44d4-9bbe-c8f0218c413d service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] No waiting events found dispatching network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:49:51 user nova-compute[75205]: WARNING nova.compute.manager [req-87a5b513-98a7-4baa-9e83-7a7a7e61642c req-0de5d7b4-bc47-44d4-9bbe-c8f0218c413d service nova] [instance: bb6adf57-89a2-4b72-8520-504007ba66ca] Received unexpected event network-vif-plugged-619e7fe6-d7ae-413b-9d12-92298997364b for instance with vm_state deleted and task_state None.
Nov 14 19:49:52 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:49:52 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:49:52 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:49:52 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=25.017810821533203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:49:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:49:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:49:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:49:55 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:49:56 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:49:59 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:49:59 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:02 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:50:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:50:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:50:06 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:06 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:12 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 19:50:12 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] There are 0 instances to clean {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 19:50:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:20 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:20 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75205) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 19:50:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:50:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:50:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:50:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:50:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:50:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:42 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:50:52 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:50:52 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:50:52 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=9208MB free_disk=25.05382537841797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing inventories for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Updating ProviderTree inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:50:52 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing aggregate associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, aggregates: None {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 19:50:53 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing trait associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, traits: HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 19:50:53 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:50:53 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:50:53 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:50:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:50:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:50:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:50:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:51:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:51:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:51:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:51:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:51:02 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:51:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:51:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:51:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:51:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:51:06 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:51:09 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:12 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:16 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:51:17 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:19 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:21 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:51:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:51:27 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Starting instance... {{(pid=75205) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 19:51:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:51:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:51:27 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75205) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 19:51:27 user nova-compute[75205]: INFO nova.compute.claims [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Claim successful on node user
Nov 14 19:51:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:27 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:51:27 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Start building networks asynchronously for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Allocating IP information in the background. {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] allocate_for_instance() {{(pid=75205) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 19:51:28 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 19:51:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Start building block device mappings for instance. {{(pid=75205) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG nova.policy [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7e30ec1e9d04b71856c92b6dea20f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3dd807ba7d4edb806ed31f00fbe41b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75205) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Start spawning the instance on the hypervisor. {{(pid=75205) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Creating instance directory {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 19:51:28 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Creating image(s)
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "/opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "/opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "/opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.194s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk 1073741824 {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de,backing_fmt=raw /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk 1073741824" returned: 0 in 0.054s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "0fe91193df1c40dd26113d6286d0d3c3e62b24de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fe91193df1c40dd26113d6286d0d3c3e62b24de --force-share --output=json" returned: 0 in 0.187s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk. size=1073741824 {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:51:28 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Successfully created port: e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 19:51:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:51:29 user nova-compute[75205]: DEBUG nova.virt.disk.api [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Cannot resize image /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk to a smaller size. {{(pid=75205) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 19:51:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Created local disks {{(pid=75205) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 19:51:29 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Ensure instance console log exists: /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/console.log {{(pid=75205) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 19:51:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:51:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:51:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Successfully updated port: e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquired lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Building network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.compute.manager [req-572bfe45-3009-4c68-a62b-6a177bfa4b8d req-d281bc06-3524-4c47-9935-e44463141b66 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received event network-changed-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.compute.manager [req-572bfe45-3009-4c68-a62b-6a177bfa4b8d req-d281bc06-3524-4c47-9935-e44463141b66 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Refreshing instance network info cache due to event network-changed-e62b0665-ee67-4ec7-8884-ab2edac6aec3. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-572bfe45-3009-4c68-a62b-6a177bfa4b8d req-d281bc06-3524-4c47-9935-e44463141b66 service nova] Acquiring lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Instance cache missing network info. {{(pid=75205) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.neutron [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating instance_info_cache with network_info: [{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Releasing lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Instance network_info: |[{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75205) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-572bfe45-3009-4c68-a62b-6a177bfa4b8d req-d281bc06-3524-4c47-9935-e44463141b66 service nova] Acquired lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.neutron [req-572bfe45-3009-4c68-a62b-6a177bfa4b8d req-d281bc06-3524-4c47-9935-e44463141b66 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Refreshing network info cache for port e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Start _get_guest_xml network_info=[{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '992ee33c-41f8-4ea7-bc15-8d73f5a51f6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 19:51:30 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:51:30 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] CPU controller missing on host. {{(pid=75205) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.host [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] CPU controller found on host. {{(pid=75205) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75205) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T19:04:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T19:04:43Z,direct_url=<?>,disk_format='qcow2',id=992ee33c-41f8-4ea7-bc15-8d73f5a51f6d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7d3978d4ce0a499fa185e937ee9bde95',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T19:04:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Flavor limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Image limits 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Flavor pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Image pref 0:0:0 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75205) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Got 1 possible topologies {{(pid=75205) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.hardware [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75205) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-609256413',display_name='tempest-SnapshotDataIntegrityTests-server-609256413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-609256413',id=53,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU+PFyJhR9fOoMaYyi7j6jm6okk727WnHd7JUPb58MWkbLVuZKXoK9Y+77lglOU6/UsZ0kE6SwKBNj/4tvyRXZ+oSvfD7Zq8ocFEfvs/2GfbKb+9TaH8xVTddiFq7kz3A==',key_name='tempest-keypair-1697562762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a3dd807ba7d4edb806ed31f00fbe41b',ramdisk_id='',reservation_id='r-k0oflo0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1436001181',owner_user_name='tempest-SnapshotDataIntegrityTests-1436001181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7e30ec1e9d04b71856c92b6dea20f10',uuid=7eea8605-7538-4c1e-952b-dd6dd5bbc600,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75205) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Converting VIF {"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:3c:64,bridge_name='br-int',has_traffic_filtering=True,id=e62b0665-ee67-4ec7-8884-ab2edac6aec3,network=Network(78af7dd1-4f54-433c-9625-ccea2da68464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b0665-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'pci_devices' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] End _get_guest_xml xml=<domain type="kvm">
Nov 14 19:51:30 user nova-compute[75205]:   <uuid>7eea8605-7538-4c1e-952b-dd6dd5bbc600</uuid>
Nov 14 19:51:30 user nova-compute[75205]:   <name>instance-00000035</name>
Nov 14 19:51:30 user nova-compute[75205]:   <memory>524288</memory>
Nov 14 19:51:30 user nova-compute[75205]:   <vcpu>1</vcpu>
Nov 14 19:51:30 user nova-compute[75205]:   <metadata>
Nov 14 19:51:30 user nova-compute[75205]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 19:51:30 user nova-compute[75205]:       <nova:package version="0.0.0"/>
Nov 14 19:51:30 user nova-compute[75205]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-609256413</nova:name>
Nov 14 19:51:30 user nova-compute[75205]:       <nova:creationTime>2023-11-14 19:51:30</nova:creationTime>
Nov 14 19:51:30 user nova-compute[75205]:       <nova:flavor name="m1.tiny">
Nov 14 19:51:30 user nova-compute[75205]:         <nova:memory>512</nova:memory>
Nov 14 19:51:30 user nova-compute[75205]:         <nova:disk>1</nova:disk>
Nov 14 19:51:30 user nova-compute[75205]:         <nova:swap>0</nova:swap>
Nov 14 19:51:30 user nova-compute[75205]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 19:51:30 user nova-compute[75205]:         <nova:vcpus>1</nova:vcpus>
Nov 14 19:51:30 user nova-compute[75205]:       </nova:flavor>
Nov 14 19:51:30 user nova-compute[75205]:       <nova:owner>
Nov 14 19:51:30 user nova-compute[75205]:         <nova:user uuid="f7e30ec1e9d04b71856c92b6dea20f10">tempest-SnapshotDataIntegrityTests-1436001181-project-member</nova:user>
Nov 14 19:51:30 user nova-compute[75205]:         <nova:project uuid="5a3dd807ba7d4edb806ed31f00fbe41b">tempest-SnapshotDataIntegrityTests-1436001181</nova:project>
Nov 14 19:51:30 user nova-compute[75205]:       </nova:owner>
Nov 14 19:51:30 user nova-compute[75205]:       <nova:root type="image" uuid="992ee33c-41f8-4ea7-bc15-8d73f5a51f6d"/>
Nov 14 19:51:30 user nova-compute[75205]:       <nova:ports>
Nov 14 19:51:30 user nova-compute[75205]:         <nova:port uuid="e62b0665-ee67-4ec7-8884-ab2edac6aec3">
Nov 14 19:51:30 user nova-compute[75205]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 19:51:30 user nova-compute[75205]:         </nova:port>
Nov 14 19:51:30 user nova-compute[75205]:       </nova:ports>
Nov 14 19:51:30 user nova-compute[75205]:     </nova:instance>
Nov 14 19:51:30 user nova-compute[75205]:   </metadata>
Nov 14 19:51:30 user nova-compute[75205]:   <sysinfo type="smbios">
Nov 14 19:51:30 user nova-compute[75205]:     <system>
Nov 14 19:51:30 user nova-compute[75205]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 19:51:30 user nova-compute[75205]:       <entry name="product">OpenStack Nova</entry>
Nov 14 19:51:30 user nova-compute[75205]:       <entry name="version">0.0.0</entry>
Nov 14 19:51:30 user nova-compute[75205]:       <entry name="serial">7eea8605-7538-4c1e-952b-dd6dd5bbc600</entry>
Nov 14 19:51:30 user nova-compute[75205]:       <entry name="uuid">7eea8605-7538-4c1e-952b-dd6dd5bbc600</entry>
Nov 14 19:51:30 user nova-compute[75205]:       <entry name="family">Virtual Machine</entry>
Nov 14 19:51:30 user nova-compute[75205]:     </system>
Nov 14 19:51:30 user nova-compute[75205]:   </sysinfo>
Nov 14 19:51:30 user nova-compute[75205]:   <os>
Nov 14 19:51:30 user nova-compute[75205]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 19:51:30 user nova-compute[75205]:     <boot dev="hd"/>
Nov 14 19:51:30 user nova-compute[75205]:     <smbios mode="sysinfo"/>
Nov 14 19:51:30 user nova-compute[75205]:   </os>
Nov 14 19:51:30 user nova-compute[75205]:   <features>
Nov 14 19:51:30 user nova-compute[75205]:     <acpi/>
Nov 14 19:51:30 user nova-compute[75205]:     <apic/>
Nov 14 19:51:30 user nova-compute[75205]:     <vmcoreinfo/>
Nov 14 19:51:30 user nova-compute[75205]:   </features>
Nov 14 19:51:30 user nova-compute[75205]:   <clock offset="utc">
Nov 14 19:51:30 user nova-compute[75205]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 19:51:30 user nova-compute[75205]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 19:51:30 user nova-compute[75205]:     <timer name="hpet" present="no"/>
Nov 14 19:51:30 user nova-compute[75205]:   </clock>
Nov 14 19:51:30 user nova-compute[75205]:   <cpu mode="custom" match="exact">
Nov 14 19:51:30 user nova-compute[75205]:     <model>Nehalem</model>
Nov 14 19:51:30 user nova-compute[75205]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 19:51:30 user nova-compute[75205]:   </cpu>
Nov 14 19:51:30 user nova-compute[75205]:   <devices>
Nov 14 19:51:30 user nova-compute[75205]:     <disk type="file" device="disk">
Nov 14 19:51:30 user nova-compute[75205]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 19:51:30 user nova-compute[75205]:       <source file="/opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk"/>
Nov 14 19:51:30 user nova-compute[75205]:       <target dev="vda" bus="virtio"/>
Nov 14 19:51:30 user nova-compute[75205]:     </disk>
Nov 14 19:51:30 user nova-compute[75205]:     <interface type="ethernet">
Nov 14 19:51:30 user nova-compute[75205]:       <mac address="fa:16:3e:15:3c:64"/>
Nov 14 19:51:30 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:51:30 user nova-compute[75205]:       <mtu size="1442"/>
Nov 14 19:51:30 user nova-compute[75205]:       <target dev="tape62b0665-ee"/>
Nov 14 19:51:30 user nova-compute[75205]:     </interface>
Nov 14 19:51:30 user nova-compute[75205]:     <serial type="pty">
Nov 14 19:51:30 user nova-compute[75205]:       <log file="/opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/console.log" append="off"/>
Nov 14 19:51:30 user nova-compute[75205]:     </serial>
Nov 14 19:51:30 user nova-compute[75205]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 19:51:30 user nova-compute[75205]:     <video>
Nov 14 19:51:30 user nova-compute[75205]:       <model type="virtio"/>
Nov 14 19:51:30 user nova-compute[75205]:     </video>
Nov 14 19:51:30 user nova-compute[75205]:     <rng model="virtio">
Nov 14 19:51:30 user nova-compute[75205]:       <backend model="random">/dev/urandom</backend>
Nov 14 19:51:30 user nova-compute[75205]:     </rng>
Nov 14 19:51:30 user nova-compute[75205]:     <controller type="usb" index="0" model="none"/>
Nov 14 19:51:30 user nova-compute[75205]:     <memballoon model="virtio">
Nov 14 19:51:30 user nova-compute[75205]:       <stats period="10"/>
Nov 14 19:51:30 user nova-compute[75205]:     </memballoon>
Nov 14 19:51:30 user nova-compute[75205]:   </devices>
Nov 14 19:51:30 user nova-compute[75205]: </domain>
Nov 14 19:51:30 user nova-compute[75205]:  {{(pid=75205) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-609256413',display_name='tempest-SnapshotDataIntegrityTests-server-609256413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-609256413',id=53,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU+PFyJhR9fOoMaYyi7j6jm6okk727WnHd7JUPb58MWkbLVuZKXoK9Y+77lglOU6/UsZ0kE6SwKBNj/4tvyRXZ+oSvfD7Zq8ocFEfvs/2GfbKb+9TaH8xVTddiFq7kz3A==',key_name='tempest-keypair-1697562762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a3dd807ba7d4edb806ed31f00fbe41b',ramdisk_id='',reservation_id='r-k0oflo0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1436001181',owner_user_name='tempest-SnapshotDataIntegrityTests-1436001181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T19:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7e30ec1e9d04b71856c92b6dea20f10',uuid=7eea8605-7538-4c1e-952b-dd6dd5bbc600,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Converting VIF {"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:3c:64,bridge_name='br-int',has_traffic_filtering=True,id=e62b0665-ee67-4ec7-8884-ab2edac6aec3,network=Network(78af7dd1-4f54-433c-9625-ccea2da68464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b0665-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG os_vif [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:3c:64,bridge_name='br-int',has_traffic_filtering=True,id=e62b0665-ee67-4ec7-8884-ab2edac6aec3,network=Network(78af7dd1-4f54-433c-9625-ccea2da68464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b0665-ee') {{(pid=75205) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '231dd298-9330-5699-84dc-06e513559109', '_type': 'linux-noop'}}, row=False) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape62b0665-ee, may_exist=True, interface_attrs={}) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape62b0665-ee, col_values=(('qos', UUID('222675ea-5729-4045-af7f-abc4af613982')),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape62b0665-ee, col_values=(('external_ids', {'iface-id': 'e62b0665-ee67-4ec7-8884-ab2edac6aec3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:3c:64', 'vm-uuid': '7eea8605-7538-4c1e-952b-dd6dd5bbc600'}),), if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:30 user nova-compute[75205]: INFO os_vif [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:3c:64,bridge_name='br-int',has_traffic_filtering=True,id=e62b0665-ee67-4ec7-8884-ab2edac6aec3,network=Network(78af7dd1-4f54-433c-9625-ccea2da68464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b0665-ee')
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No VIF found with MAC fa:16:3e:15:3c:64, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.neutron [req-572bfe45-3009-4c68-a62b-6a177bfa4b8d req-d281bc06-3524-4c47-9935-e44463141b66 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updated VIF entry in instance network info cache for port e62b0665-ee67-4ec7-8884-ab2edac6aec3. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG nova.network.neutron [req-572bfe45-3009-4c68-a62b-6a177bfa4b8d req-d281bc06-3524-4c47-9935-e44463141b66 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating instance_info_cache with network_info: [{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:51:30 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-572bfe45-3009-4c68-a62b-6a177bfa4b8d req-d281bc06-3524-4c47-9935-e44463141b66 service nova] Releasing lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:51:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-68aa1add-f789-4612-883b-5c53af488090 req-95283a22-c5a4-4b2d-bdbf-1aa0d7890dcd service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received event network-vif-plugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:51:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-68aa1add-f789-4612-883b-5c53af488090 req-95283a22-c5a4-4b2d-bdbf-1aa0d7890dcd service nova] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:51:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-68aa1add-f789-4612-883b-5c53af488090 req-95283a22-c5a4-4b2d-bdbf-1aa0d7890dcd service nova] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:51:32 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-68aa1add-f789-4612-883b-5c53af488090 req-95283a22-c5a4-4b2d-bdbf-1aa0d7890dcd service nova] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:51:32 user nova-compute[75205]: DEBUG nova.compute.manager [req-68aa1add-f789-4612-883b-5c53af488090 req-95283a22-c5a4-4b2d-bdbf-1aa0d7890dcd service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] No waiting events found dispatching network-vif-plugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:51:32 user nova-compute[75205]: WARNING nova.compute.manager [req-68aa1add-f789-4612-883b-5c53af488090 req-95283a22-c5a4-4b2d-bdbf-1aa0d7890dcd service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received unexpected event network-vif-plugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 for instance with vm_state building and task_state spawning.
Nov 14 19:51:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Instance event wait completed in 0 seconds for  {{(pid=75205) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Guest created on hypervisor {{(pid=75205) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 19:51:34 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Instance spawned successfully.
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Found default for hw_cdrom_bus of ide {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Found default for hw_disk_bus of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Found default for hw_input_bus of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Found default for hw_pointer_model of None {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Found default for hw_video_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Found default for hw_vif_model of virtio {{(pid=75205) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-a08f2c44-8c56-47fd-955d-f9c027597665 req-3776efcc-6967-4d77-ae2e-68becd60bdd2 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received event network-vif-plugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a08f2c44-8c56-47fd-955d-f9c027597665 req-3776efcc-6967-4d77-ae2e-68becd60bdd2 service nova] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a08f2c44-8c56-47fd-955d-f9c027597665 req-3776efcc-6967-4d77-ae2e-68becd60bdd2 service nova] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-a08f2c44-8c56-47fd-955d-f9c027597665 req-3776efcc-6967-4d77-ae2e-68becd60bdd2 service nova] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.compute.manager [req-a08f2c44-8c56-47fd-955d-f9c027597665 req-3776efcc-6967-4d77-ae2e-68becd60bdd2 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] No waiting events found dispatching network-vif-plugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:51:34 user nova-compute[75205]: WARNING nova.compute.manager [req-a08f2c44-8c56-47fd-955d-f9c027597665 req-3776efcc-6967-4d77-ae2e-68becd60bdd2 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received unexpected event network-vif-plugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 for instance with vm_state building and task_state spawning.
Nov 14 19:51:34 user nova-compute[75205]: INFO nova.compute.manager [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 14 19:51:34 user nova-compute[75205]: DEBUG nova.compute.manager [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Checking state {{(pid=75205) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 19:51:34 user nova-compute[75205]: INFO nova.compute.manager [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Took 6.80 seconds to build instance.
Nov 14 19:51:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8975e330-f3b9-44f5-ba59-343b8f0e8220 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.919s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:51:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:47 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:53 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:51:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:51:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:51:53 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:51:53 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:51:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:51:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:51:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:51:53 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:51:54 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:51:54 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:51:54 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8852MB free_disk=25.012317657470703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:51:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:51:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:51:54 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:51:54 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:51:54 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:51:54 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:51:54 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:51:54 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:51:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:51:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:57 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:51:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:51:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:51:58 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:52:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:52:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:52:02 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:52:02 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:03 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:52:04 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:52:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:52:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:52:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:52:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:52:04 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:52:04 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:52:04 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating instance_info_cache with network_info: [{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:52:04 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:52:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:52:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:06 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:52:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:52:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:52:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:52:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:52:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:52:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:52:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:54 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:52:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:52:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:52:54 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:52:54 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:52:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:52:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:52:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:52:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:52:55 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:52:55 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:52:55 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=25.009960174560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:52:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:52:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:53:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:53:00 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:53:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:53:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:53:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:53:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:02 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:53:03 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:53:03 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:53:04 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:53:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:06 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:53:06 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:53:06 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:53:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:53:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:53:06 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:53:06 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:53:06 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating instance_info_cache with network_info: [{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:53:06 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:53:06 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:53:07 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:53:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:53:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:53:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:53:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:53:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:53:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:53:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-22a8dc0a-30c2-418e-ad33-884ca75caccd req-487e7cf3-2717-499a-8cfa-cfe0ca5f650b service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received event network-changed-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:53:18 user nova-compute[75205]: DEBUG nova.compute.manager [req-22a8dc0a-30c2-418e-ad33-884ca75caccd req-487e7cf3-2717-499a-8cfa-cfe0ca5f650b service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Refreshing instance network info cache due to event network-changed-e62b0665-ee67-4ec7-8884-ab2edac6aec3. {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 19:53:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-22a8dc0a-30c2-418e-ad33-884ca75caccd req-487e7cf3-2717-499a-8cfa-cfe0ca5f650b service nova] Acquiring lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:53:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-22a8dc0a-30c2-418e-ad33-884ca75caccd req-487e7cf3-2717-499a-8cfa-cfe0ca5f650b service nova] Acquired lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:53:18 user nova-compute[75205]: DEBUG nova.network.neutron [req-22a8dc0a-30c2-418e-ad33-884ca75caccd req-487e7cf3-2717-499a-8cfa-cfe0ca5f650b service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Refreshing network info cache for port e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 19:53:18 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:53:18 user nova-compute[75205]: DEBUG nova.network.neutron [req-22a8dc0a-30c2-418e-ad33-884ca75caccd req-487e7cf3-2717-499a-8cfa-cfe0ca5f650b service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updated VIF entry in instance network info cache for port e62b0665-ee67-4ec7-8884-ab2edac6aec3. {{(pid=75205) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 19:53:18 user nova-compute[75205]: DEBUG nova.network.neutron [req-22a8dc0a-30c2-418e-ad33-884ca75caccd req-487e7cf3-2717-499a-8cfa-cfe0ca5f650b service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating instance_info_cache with network_info: [{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:53:18 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-22a8dc0a-30c2-418e-ad33-884ca75caccd req-487e7cf3-2717-499a-8cfa-cfe0ca5f650b service nova] Releasing lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:53:20 user nova-compute[75205]: INFO nova.compute.manager [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attaching volume df2b89df-90c8-4d79-9622-36d6f9932911 to /dev/vdb
Nov 14 19:53:20 user nova-compute[75205]: DEBUG os_brick.utils [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ec430a-d3a3-487d-aeee-2c0d34dc5388]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1be8ca3-de20-4efd-8181-6bb757a9bf98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a4d924-4d97-4d0f-bac9-e6e508100267]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8decb6d-24c5-41c6-9b7e-e4fd94644ffd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:20 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:53:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:53:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:21 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:53:21 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:53:21 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a747569c-9954-40b4-80b9-65db0734f770]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:53:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:53:21 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:53:21 user nova-compute[75205]: DEBUG os_brick.utils [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:53:21 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating existing volume attachment record: 50d416b9-f080-444d-8eb0-391a62d7d314 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:53:22 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaFJEdhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:53:25 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:53:25 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:53:25 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb40784-d1bf-4fb8-8f45-cde57c72deca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:53:25 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef7ed43-019e-4182-aada-0ed7c088d25b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911] added
Nov 14 19:53:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47bd415-26de-4018-a071-a44072e1ab35]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2518650b-25ee-4b39-946e-b2ea52ea9b81]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaFJEdhC {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaFJEdhC" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5246ce8-93da-43ff-8c48-8fc2cdcc2313]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IaFJEdhC'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dd4629-6dbd-41b8-b1e1-0e6cae08cc15]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb20e3d5-0adb-49a3-8f4d-4cf0f57f2ad6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:53:25 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:53:25 user nova-compute[75205]:  {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:53:25 user nova-compute[75205]: WARNING os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 19:53:25 user nova-compute[75205]: 
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe4b878-6c0d-460c-8c97-fcda81573442]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911, portal: 172.16.0.220,3260]
Nov 14 19:53:25 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911, portal: 172.16.0.220,3260] successful.
Nov 14 19:53:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a18011f-82fa-4dc3-8974-e4bca7bd7368]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5698efa4-2873-41d2-8395-649d72e01c40]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 (non-flash)
Nov 14 19:53:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 (non-flash)
Nov 14 19:53:25 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e251dc00-9b9f-4fb8-8a34-86bd4df51e2e]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:25 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:53:26 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:53:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaFJEdhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:53:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:53:26 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26339333933383432', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:53:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339333933383432', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:53:26 user nova-compute[75205]: DEBUG nova.objects.instance [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:53:26 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:53:26 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:53:26 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:53:26 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:53:26 user nova-compute[75205]:   <serial>df2b89df-90c8-4d79-9622-36d6f9932911</serial>
Nov 14 19:53:26 user nova-compute[75205]: </disk>
Nov 14 19:53:26 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:53:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:53:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:53:27 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No VIF found with MAC fa:16:3e:15:3c:64, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:53:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-5fdbdd04-cf1d-4823-9539-4ab80f8a13ce tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.324s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:53:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:53:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:53:34 user nova-compute[75205]: INFO nova.compute.manager [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Detaching volume df2b89df-90c8-4d79-9622-36d6f9932911
Nov 14 19:53:34 user nova-compute[75205]: INFO nova.virt.block_device [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attempting to driver detach volume df2b89df-90c8-4d79-9622-36d6f9932911 from mountpoint /dev/vdb
Nov 14 19:53:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Attempting to detach device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:53:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:53:34 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:53:34 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:53:34 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:53:34 user nova-compute[75205]:   <serial>df2b89df-90c8-4d79-9622-36d6f9932911</serial>
Nov 14 19:53:34 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:53:34 user nova-compute[75205]: </disk>
Nov 14 19:53:34 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:53:34 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Successfully detached device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the persistent domain config.
Nov 14 19:53:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:53:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:53:34 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:53:34 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:53:34 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:53:34 user nova-compute[75205]:   <serial>df2b89df-90c8-4d79-9622-36d6f9932911</serial>
Nov 14 19:53:34 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:53:34 user nova-compute[75205]: </disk>
Nov 14 19:53:34 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:53:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:53:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:53:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:53:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:53:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:53:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:52 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:54 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 is timed out.
Nov 14 19:53:54 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Successfully detached device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the live domain config.
Nov 14 19:53:54 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:53:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaFJEdhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:53:54 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:53:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:53:54 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:53:54 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d72799-cac0-41ee-be3f-73aa863c864e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:53:55 user nova-compute[75205]: No targets found.
Nov 14 19:53:55 user nova-compute[75205]: iSNS:
Nov 14 19:53:55 user nova-compute[75205]: No targets found.
Nov 14 19:53:55 user nova-compute[75205]: STATIC:
Nov 14 19:53:55 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911
Nov 14 19:53:55 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:53:55 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:53:55 user nova-compute[75205]: FIRMWARE:
Nov 14 19:53:55 user nova-compute[75205]: No targets found.
Nov 14 19:53:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:53:55 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:53:55 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8539895-9dc1-4a4d-ab55-d2535f68f173]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[429ef53e-171e-4212-8cd4-d89c159c46e9]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 (non-flash)
Nov 14 19:53:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 (non-flash)
Nov 14 19:53:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb94bdea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f34994-1e8f-46e4-87de-92b2a12c8e1a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eda2330-b81c-4f23-b747-4b79722370da]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ec9896-4cd7-4d66-bccd-658fbad9112e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7c5dbf-54ad-4140-a160-fe4ce4b22bb5]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[97619f54-98b0-43bc-b71a-d009808c2ed9]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[938ec0d1-f72d-4fa6-8a29-4ca0b8699b0a]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911, portal: 172.16.0.220,3260]
Nov 14 19:53:55 user nova-compute[75205]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911, portal: 172.16.0.220,3260] successful.
Nov 14 19:53:55 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2b89df-90c8-4d79-9622-36d6f9932911 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c32ba4d-c439-4ed7-8911-6e76ba1a5016]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== disconnect_volume: return (288ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:53:55 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG nova.objects.instance [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:53:56 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:53:56 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:53:56 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=25.008628845214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-f6be83c6-3e6b-41f9-b9b2-17cc82d988e4 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.915s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:53:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:54:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:54:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:54:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:02 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:54:02 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:54:02 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:54:04 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:54:05 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:54:05 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:54:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:07 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:54:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:54:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:54:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:54:07 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:54:07 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:54:07 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:54:08 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating instance_info_cache with network_info: [{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:54:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:54:08 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:54:10 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:54:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:54:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:54:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:54:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG nova.objects.instance [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:54:27 user nova-compute[75205]: INFO nova.compute.manager [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attaching volume 51db6081-6628-49ed-86b2-7bcc6753ebb0 to /dev/vdb
Nov 14 19:54:27 user nova-compute[75205]: DEBUG os_brick.utils [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[98089798-4372-4b3d-b46b-b873b9bf2ea7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64da02e-459f-4d2d-9ba8-9305d150ea77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[06492edc-c370-4acb-b133-642075f52402]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[078e4675-4327-45f3-878c-a7e9f77a3279]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:54:27 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:54:27 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[beed1ba4-6c5c-491e-9309-de4483352fbd]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG os_brick.utils [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating existing volume attachment record: 737004c1-81e8-4d89-9203-0c322db96e5b {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:54:27 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCPczBqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:54:32 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:54:32 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:54:32 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b36164-4970-4a8c-aca8-b21887e4cb14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:54:32 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7517d7ed-0c77-4050-a6fa-de23ac9d35b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0] added
Nov 14 19:54:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86bdb8f-e117-4640-8864-e4fedf728f4a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b3d55c-63e3-472f-a0db-6751e89bdc16]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCPczBqt {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCPczBqt" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[130feefb-7791-40e1-aabf-51cc4fd7216a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UCPczBqt'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2250f-db8a-4d4f-8c25-a464bc4e0ab3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[939ea7cd-697e-4348-8be6-c5a95e161064]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:54:32 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:54:32 user nova-compute[75205]:  {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:54:32 user nova-compute[75205]: WARNING os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 19:54:32 user nova-compute[75205]: 
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5339e4-676b-45e3-a8e6-4fd5a1aa502a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0, portal: 172.16.0.220,3260]
Nov 14 19:54:32 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0, portal: 172.16.0.220,3260] successful.
Nov 14 19:54:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.065s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[742bc2ac-df18-4d7b-9d35-45cde9ce29ba]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47aca6b-d0a8-43d1-82b6-ba9cac2706d8]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 (non-flash)
Nov 14 19:54:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 (non-flash)
Nov 14 19:54:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39efbe0-57f9-476c-af24-cd34d7f9d024]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:54:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCPczBqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:54:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:54:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26566636335363163', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:54:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566636335363163', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:54:33 user nova-compute[75205]: DEBUG nova.objects.instance [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:54:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:54:33 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:54:33 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:54:33 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:54:33 user nova-compute[75205]:   <serial>51db6081-6628-49ed-86b2-7bcc6753ebb0</serial>
Nov 14 19:54:33 user nova-compute[75205]: </disk>
Nov 14 19:54:33 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:54:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:54:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:54:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No VIF found with MAC fa:16:3e:15:3c:64, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:54:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-a6f703ee-2242-4c10-9110-6dd370892e41 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.947s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:54:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:54:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:54:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:54:36 user nova-compute[75205]: INFO nova.compute.manager [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Detaching volume 51db6081-6628-49ed-86b2-7bcc6753ebb0
Nov 14 19:54:36 user nova-compute[75205]: INFO nova.virt.block_device [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attempting to driver detach volume 51db6081-6628-49ed-86b2-7bcc6753ebb0 from mountpoint /dev/vdb
Nov 14 19:54:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Attempting to detach device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:54:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:54:36 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:54:36 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:54:36 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:54:36 user nova-compute[75205]:   <serial>51db6081-6628-49ed-86b2-7bcc6753ebb0</serial>
Nov 14 19:54:36 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:54:36 user nova-compute[75205]: </disk>
Nov 14 19:54:36 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:54:36 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Successfully detached device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the persistent domain config.
Nov 14 19:54:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:54:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:54:36 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:54:36 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:54:36 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:54:36 user nova-compute[75205]:   <serial>51db6081-6628-49ed-86b2-7bcc6753ebb0</serial>
Nov 14 19:54:36 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:54:36 user nova-compute[75205]: </disk>
Nov 14 19:54:36 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:54:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:54:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:54:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:54:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:54:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:54:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:54:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:56 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 is timed out.
Nov 14 19:54:56 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Successfully detached device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the live domain config.
Nov 14 19:54:56 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCPczBqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:54:56 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:54:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[638a0e87-4f43-45a2-af9d-910817e2103c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:54:56 user nova-compute[75205]: No targets found.
Nov 14 19:54:56 user nova-compute[75205]: iSNS:
Nov 14 19:54:56 user nova-compute[75205]: No targets found.
Nov 14 19:54:56 user nova-compute[75205]: STATIC:
Nov 14 19:54:56 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0
Nov 14 19:54:56 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:54:56 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:54:56 user nova-compute[75205]: FIRMWARE:
Nov 14 19:54:56 user nova-compute[75205]: No targets found.
Nov 14 19:54:56 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:54:56 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:54:56 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[86eef499-7552-4318-bcaf-865f0c51e370]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e5143-0fd1-45de-a64b-313448d1048d]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 (non-flash)
Nov 14 19:54:56 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 (non-flash)
Nov 14 19:54:56 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb94b38700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:54:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2f077f-d900-4c6c-bb8b-a4a8b67d4a1f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:57 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:54:57 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:54:57 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=25.00772476196289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e24ead9-cb3e-4dd0-8705-ca8f6c7799f6]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12794f2-f6ea-4365-9388-c9a48c96af1b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b2c048-a75a-44e0-bc78-e16c851d2389]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc84e17-c9a4-43f4-af19-9f9e7d3e054e]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2842ff3-1ede-4b66-9027-8f61a643b503]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0, portal: 172.16.0.220,3260]
Nov 14 19:54:57 user nova-compute[75205]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0, portal: 172.16.0.220,3260] successful.
Nov 14 19:54:57 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51db6081-6628-49ed-86b2-7bcc6753ebb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b406815-4b08-4aec-a03d-766df93d61b3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.616s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== disconnect_volume: return (617ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:54:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:54:58 user nova-compute[75205]: DEBUG nova.objects.instance [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:54:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-7d37ccfe-75ea-4767-a000-839f0acad853 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.923s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:55:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:55:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:01 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:02 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:04 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:04 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:55:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:55:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:06 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:06 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:07 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:07 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:08 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:08 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:55:08 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:55:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:55:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:55:08 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:55:08 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:55:08 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating instance_info_cache with network_info: [{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:55:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:55:08 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:55:09 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:15 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 19:55:15 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] There are 0 instances to clean {{(pid=75205) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 19:55:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:55:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:21 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:22 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:22 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75205) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 19:55:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:55:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG nova.objects.instance [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:55:28 user nova-compute[75205]: INFO nova.compute.manager [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attaching volume 8e55095d-c0cb-4d3a-b0ba-b33aaae27909 to /dev/vdb
Nov 14 19:55:28 user nova-compute[75205]: DEBUG os_brick.utils [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6912d632-cae3-48b5-94ce-bd42c987daef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfae994b-dfbe-4f5b-adcf-c5135a2dfcdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a6eacd-fc5c-49e3-8615-0fb1f234b7bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad143555-bf33-4565-9a8f-da2430601707]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:55:28 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:55:28 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1264ee8b-01f4-4873-9c1a-c415efd3d44c]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG os_brick.utils [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:55:28 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating existing volume attachment record: 2320db92-1c25-4033-a054-1300486f49f1 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:55:29 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:29 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Triggering sync for uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 19:55:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:55:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:55:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKtcUTfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:55:32 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:55:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:55:32 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:55:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:55:32 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd68a5e-62f2-4189-8abd-ddf8f21c5e6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:55:32 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19e61f1-b221-47d0-aa65-105f1661a0a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909] added
Nov 14 19:55:32 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3830ba-82e4-4a32-bf56-9f6cc1d747e7]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6c14bf-ac3d-4052-91b2-031a8fd54d6b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:32 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKtcUTfV {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKtcUTfV" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb904eda-5f37-4c97-b47b-b9582004582d]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rKtcUTfV'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af52e08-e838-407f-9dd3-def12b116e4b]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4477226-f80c-494f-aaa5-4b2f5752ca38]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:55:33 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:55:33 user nova-compute[75205]:  {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:55:33 user nova-compute[75205]: WARNING os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 19:55:33 user nova-compute[75205]: 
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[def16276-92ca-4724-b7cc-5b14766ff599]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909, portal: 172.16.0.220,3260]
Nov 14 19:55:33 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909, portal: 172.16.0.220,3260] successful.
Nov 14 19:55:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e0461-1597-4e81-890c-4d32a7299897]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9ba3e1-b81c-43ea-85dd-eceeaf1442c6]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 (non-flash)
Nov 14 19:55:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 (non-flash)
Nov 14 19:55:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[93507a04-603e-4dbc-8acc-817c38feb873]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:33 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKtcUTfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23838316363363436', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838316363363436', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG nova.objects.instance [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:55:34 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:55:34 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:55:34 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:55:34 user nova-compute[75205]:   <serial>8e55095d-c0cb-4d3a-b0ba-b33aaae27909</serial>
Nov 14 19:55:34 user nova-compute[75205]: </disk>
Nov 14 19:55:34 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No VIF found with MAC fa:16:3e:15:3c:64, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-12749ed9-d519-4530-8dc4-1078c3002a47 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.103s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.012s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:55:34 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:55:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:55:36 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:55:36 user nova-compute[75205]: INFO nova.compute.manager [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Detaching volume 8e55095d-c0cb-4d3a-b0ba-b33aaae27909
Nov 14 19:55:36 user nova-compute[75205]: INFO nova.virt.block_device [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attempting to driver detach volume 8e55095d-c0cb-4d3a-b0ba-b33aaae27909 from mountpoint /dev/vdb
Nov 14 19:55:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Attempting to detach device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:55:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:55:36 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:55:36 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:55:36 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:55:36 user nova-compute[75205]:   <serial>8e55095d-c0cb-4d3a-b0ba-b33aaae27909</serial>
Nov 14 19:55:36 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:55:36 user nova-compute[75205]: </disk>
Nov 14 19:55:36 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:55:36 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Successfully detached device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the persistent domain config.
Nov 14 19:55:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:55:36 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:55:36 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:55:36 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:55:36 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:55:36 user nova-compute[75205]:   <serial>8e55095d-c0cb-4d3a-b0ba-b33aaae27909</serial>
Nov 14 19:55:36 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:55:36 user nova-compute[75205]: </disk>
Nov 14 19:55:36 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:55:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:55:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:55:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:55:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:55:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:55:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:55:56 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:55:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:55:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:55:56 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:55:56 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:55:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:56 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 is timed out.
Nov 14 19:55:57 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Successfully detached device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the live domain config.
Nov 14 19:55:57 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:55:57 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.006736755371094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKtcUTfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:55:57 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60c294b-e373-4ac2-b0bd-8777b3eeb86a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:55:57 user nova-compute[75205]: No targets found.
Nov 14 19:55:57 user nova-compute[75205]: iSNS:
Nov 14 19:55:57 user nova-compute[75205]: No targets found.
Nov 14 19:55:57 user nova-compute[75205]: STATIC:
Nov 14 19:55:57 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909
Nov 14 19:55:57 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:55:57 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:55:57 user nova-compute[75205]: FIRMWARE:
Nov 14 19:55:57 user nova-compute[75205]: No targets found.
Nov 14 19:55:57 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:55:57 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:55:57 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b36033-9920-42b1-9b4e-36f251e4f91f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff540997-b1ca-4d9d-acef-28268dae2a87]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 (non-flash)
Nov 14 19:55:57 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 (non-flash)
Nov 14 19:55:57 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb9423a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[78342758-80b7-4f3e-b63e-6614cd6751e7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing inventories for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c8a28e-4fe4-4870-91f1-8cdd73d41c15]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e235e9-4a6e-4a47-a4a3-b4fbbd366473]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Updating ProviderTree inventory for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Updating inventory in ProviderTree for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing aggregate associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, aggregates: None {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[230d6390-0c61-4f3e-ae62-9b7f7d9ccb37]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Refreshing trait associations for resource provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8, traits: HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=75205) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d8fc19-2d4c-42dc-88b6-6154e867c986]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b90c8d-852d-43c5-9a32-d01f697bbc31]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909, portal: 172.16.0.220,3260]
Nov 14 19:55:57 user nova-compute[75205]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909, portal: 172.16.0.220,3260] successful.
Nov 14 19:55:57 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e55095d-c0cb-4d3a-b0ba-b33aaae27909 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14ae41d-aacf-4385-b19a-951ec7a6eca3]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== disconnect_volume: return (297ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:55:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:55:58 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:55:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b5b6b8a4-c828-45d2-952a-e2a0e81f1ae6 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.030s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:56:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:56:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:56:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:56:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:56:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:03 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:56:03 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:56:05 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:56:05 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:56:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:56:07 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:56:08 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:56:08 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:56:08 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:56:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:56:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:56:08 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:56:08 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:56:09 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating instance_info_cache with network_info: [{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:56:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:56:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:56:09 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:56:09 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:56:09 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:56:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:56:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:56:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:56:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:56:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:56:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:56:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:56:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:56:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:56:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:56:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:56:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:56:28 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:56:28 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:56:29 user nova-compute[75205]: INFO nova.compute.manager [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attaching volume a208d514-67c3-46b1-a7c1-fa625efac08c to /dev/vdb
Nov 14 19:56:29 user nova-compute[75205]: DEBUG os_brick.utils [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f8f4d6-50b4-4cf1-9dd7-7f8a8dfebe90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9e6315ecb29\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9a8505-6842-4085-840c-b46ddfd44ca5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a13eee-b2db-4bef-ae4b-79800a141abe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4b6e9b-d4ec-40af-a9a5-0b0e414f882c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Running cmd (subprocess): nvme version {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] 'nvme version' failed. Not Retrying. {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] nvme not present on system {{(pid=75205) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 19:56:29 user nova-compute[75205]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 19:56:29 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1591fe-bc99-4270-8ceb-9ff717cc8f2d]: (4, '') {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75205) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.lightos [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] LIGHTOS: no hostnqn found. {{(pid=75205) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG os_brick.utils [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9e6315ecb29', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:56:29 user nova-compute[75205]: DEBUG nova.virt.block_device [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating existing volume attachment record: 6b19248b-f9d7-4e47-9ff7-0a5094554f48 {{(pid=75205) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 19:56:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:56:32 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Calling os-brick to attach iSCSI Volume {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruPanNGQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:56:33 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:56:33 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:56:33 user nova-compute[75205]: INFO os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[340e91f5-e4a5-41ba-9cf4-5c55d47baee7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 19:56:33 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --interface default --op new {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c170c1-b77a-42fd-a14e-d1c808fc9335]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c] added\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c] added
Nov 14 19:56:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51f3a60-47bf-4d58-9655-5b0ed90b914a]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c26e093-d22f-4e86-a135-5a9cf85846af]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruPanNGQ {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruPanNGQ" returned: 0 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc335426-26f3-423b-a7d3-efc2c1b02c27]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ruPanNGQ'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ac620b-dd8c-479d-9979-58416a4a8380]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[68355e34-82b3-4167-bd38-9fc8416b7d7c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:56:33 user nova-compute[75205]:  {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 19:56:33 user nova-compute[75205]:  {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:56:33 user nova-compute[75205]: WARNING os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 19:56:33 user nova-compute[75205]: 
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --login {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc0f118-90f3-4e5a-8991-a7b8ffda9475]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c, portal: 172.16.0.220,3260]
Nov 14 19:56:33 user nova-compute[75205]: Login to [iface: default, target: iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c, portal: 172.16.0.220,3260] successful.
Nov 14 19:56:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bf1336-0def-4e1d-a539-aecd756d7dfb]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed5098-185b-4452-a548-df5c7ab5b1c9]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c (non-flash)
Nov 14 19:56:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c (non-flash)
Nov 14 19:56:33 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Connected to 172.16.0.220:3260 {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75205) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75205) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e9f846-86f3-41bd-9d7f-1e9b0f0bf556]: (4, ('- - 0', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:33 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:56:34 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75205) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 19:56:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruPanNGQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75205) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 19:56:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:56:34 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23232363363653164', 'path': '/dev/sdb'} {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:56:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232363363653164', 'path': '/dev/sdb'} {{(pid=75205) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 19:56:34 user nova-compute[75205]: DEBUG nova.objects.instance [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:56:34 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 19:56:34 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:56:34 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:56:34 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:56:34 user nova-compute[75205]:   <serial>a208d514-67c3-46b1-a7c1-fa625efac08c</serial>
Nov 14 19:56:34 user nova-compute[75205]: </disk>
Nov 14 19:56:34 user nova-compute[75205]:  {{(pid=75205) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 19:56:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:56:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75205) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 19:56:35 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] No VIF found with MAC fa:16:3e:15:3c:64, not building metadata {{(pid=75205) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 19:56:35 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-8d3f2921-e3af-47d9-8a47-c4d28a86ab20 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.283s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:56:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:56:37 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:56:37 user nova-compute[75205]: INFO nova.compute.manager [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Detaching volume a208d514-67c3-46b1-a7c1-fa625efac08c
Nov 14 19:56:37 user nova-compute[75205]: INFO nova.virt.block_device [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Attempting to driver detach volume a208d514-67c3-46b1-a7c1-fa625efac08c from mountpoint /dev/vdb
Nov 14 19:56:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Attempting to detach device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the persistent domain config. {{(pid=75205) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 19:56:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:56:37 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:56:37 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:56:37 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:56:37 user nova-compute[75205]:   <serial>a208d514-67c3-46b1-a7c1-fa625efac08c</serial>
Nov 14 19:56:37 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:56:37 user nova-compute[75205]: </disk>
Nov 14 19:56:37 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:56:37 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Successfully detached device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the persistent domain config.
Nov 14 19:56:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the live domain config. {{(pid=75205) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 19:56:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.guest [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 19:56:37 user nova-compute[75205]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 19:56:37 user nova-compute[75205]:   <source dev="/dev/sdb"/>
Nov 14 19:56:37 user nova-compute[75205]:   <target dev="vdb" bus="virtio"/>
Nov 14 19:56:37 user nova-compute[75205]:   <serial>a208d514-67c3-46b1-a7c1-fa625efac08c</serial>
Nov 14 19:56:37 user nova-compute[75205]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 19:56:37 user nova-compute[75205]: </disk>
Nov 14 19:56:37 user nova-compute[75205]:  {{(pid=75205) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 19:56:37 user nova-compute[75205]: DEBUG nova.virt.libvirt.driver [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 19:56:37 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:56:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:56:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:56:57 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 is timed out.
Nov 14 19:56:57 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Successfully detached device vdb from instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 from the live domain config.
Nov 14 19:56:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] calling os-brick to detach iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbb7477c790>, {'target_iqn': 'iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruPanNGQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 19:56:57 user nova-compute[75205]: WARNING os_brick.initiator.connectors.base [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac995683-ae9c-4ea8-8e8f-bff27eee4ee2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 19:56:57 user nova-compute[75205]: No targets found.
Nov 14 19:56:57 user nova-compute[75205]: iSNS:
Nov 14 19:56:57 user nova-compute[75205]: No targets found.
Nov 14 19:56:57 user nova-compute[75205]: STATIC:
Nov 14 19:56:57 user nova-compute[75205]: Target: iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c
Nov 14 19:56:57 user nova-compute[75205]:         Portal: 172.16.0.220:3260,-1
Nov 14 19:56:57 user nova-compute[75205]:                 Iface Name: default
Nov 14 19:56:57 user nova-compute[75205]: FIRMWARE:
Nov 14 19:56:57 user nova-compute[75205]: No targets found.
Nov 14 19:56:57 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 19:56:57 user nova-compute[75205]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 19:56:57 user nova-compute[75205]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75205) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c', 0)] {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74f492f-9874-4213-8a0d-09ec661e329a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78a294b-2e00-4edd-9e68-13af69be3901]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c (non-flash)\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c (non-flash)
Nov 14 19:56:57 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c (non-flash)
Nov 14 19:56:57 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbb94bdea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c'): ({'sdb'}, set())}) {{(pid=75205) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Removing single pathed devices sdb {{(pid=75205) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3aca60-b742-4218-9713-88dae548babd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3498a9-5bb2-460e-8df6-01c7568a6eb4]: (4, ('ok\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Flushing IO for device /dev/sdb {{(pid=75205) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b2d59c-7385-4ae4-b023-a5293746a8bc]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75205) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a61929b-da05-4408-9d52-e6fb5afd9fe9]: (4, ('1', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.linuxscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] SCSI volumes sdb have been removed. {{(pid=75205) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c')] {{(pid=75205) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e72923-a920-44db-9fae-344c12e40c77]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --logout {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6955200e-75ce-4455-b78c-d774d3038589]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c, portal: 172.16.0.220,3260]
Nov 14 19:56:57 user nova-compute[75205]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c, portal: 172.16.0.220,3260] successful.
Nov 14 19:56:57 user nova-compute[75205]:  stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op delete {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a208d514-67c3-46b1-a7c1-fa625efac08c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5d5c84-7e2e-4717-af28-e895f050f954]: (4, ('', '')) {{(pid=85714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75205) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.base [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] <== disconnect_volume: return (259ms) None {{(pid=75205) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 19:56:57 user nova-compute[75205]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Disconnected iSCSI Volume {{(pid=75205) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG nova.objects.instance [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'flavor' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-dcfd641c-ec59-42d2-b6e2-442d33411233 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.587s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 19:56:58 user nova-compute[75205]: DEBUG oslo_concurrency.processutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 19:56:59 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:56:59 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:56:59 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=25.00576400756836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:56:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:56:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:56:59 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75205) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 19:56:59 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:56:59 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:56:59 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:56:59 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:56:59 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:56:59 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:57:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:57:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:03 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:57:03 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:57:05 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:57:05 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:57:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:57:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:08 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:57:08 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:57:08 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:57:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 19:57:08 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquired lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 19:57:08 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Forcefully refreshing network info cache for instance {{(pid=75205) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 19:57:08 user nova-compute[75205]: DEBUG nova.objects.instance [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lazy-loading 'info_cache' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:57:09 user nova-compute[75205]: DEBUG nova.network.neutron [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating instance_info_cache with network_info: [{"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:57:09 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Releasing lock "refresh_cache-7eea8605-7538-4c1e-952b-dd6dd5bbc600" {{(pid=75205) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 19:57:09 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updated the network info_cache for instance {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 19:57:09 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:57:09 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:57:09 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:57:10 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:57:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:57:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:24 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:57:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:57:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:57:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:57:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:57:40 user nova-compute[75205]: INFO nova.compute.manager [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Terminating instance
Nov 14 19:57:40 user nova-compute[75205]: DEBUG nova.compute.manager [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Start destroying the instance on the hypervisor. {{(pid=75205) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-58d58ce5-1998-4836-96c5-dbc5aec80516 req-dbf5ac95-41f3-41a8-afe1-8bc3c1b01782 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received event network-vif-unplugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-58d58ce5-1998-4836-96c5-dbc5aec80516 req-dbf5ac95-41f3-41a8-afe1-8bc3c1b01782 service nova] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-58d58ce5-1998-4836-96c5-dbc5aec80516 req-dbf5ac95-41f3-41a8-afe1-8bc3c1b01782 service nova] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-58d58ce5-1998-4836-96c5-dbc5aec80516 req-dbf5ac95-41f3-41a8-afe1-8bc3c1b01782 service nova] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-58d58ce5-1998-4836-96c5-dbc5aec80516 req-dbf5ac95-41f3-41a8-afe1-8bc3c1b01782 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] No waiting events found dispatching network-vif-unplugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG nova.compute.manager [req-58d58ce5-1998-4836-96c5-dbc5aec80516 req-dbf5ac95-41f3-41a8-afe1-8bc3c1b01782 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received event network-vif-unplugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 for instance with task_state deleting. {{(pid=75205) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [-] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Instance destroyed successfully.
Nov 14 19:57:40 user nova-compute[75205]: DEBUG nova.objects.instance [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lazy-loading 'resources' on Instance uuid 7eea8605-7538-4c1e-952b-dd6dd5bbc600 {{(pid=75205) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG nova.virt.libvirt.vif [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T19:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-609256413',display_name='tempest-SnapshotDataIntegrityTests-server-609256413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-609256413',id=53,image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU+PFyJhR9fOoMaYyi7j6jm6okk727WnHd7JUPb58MWkbLVuZKXoK9Y+77lglOU6/UsZ0kE6SwKBNj/4tvyRXZ+oSvfD7Zq8ocFEfvs/2GfbKb+9TaH8xVTddiFq7kz3A==',key_name='tempest-keypair-1697562762',keypairs=<?>,launch_index=0,launched_at=2023-11-14T19:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a3dd807ba7d4edb806ed31f00fbe41b',ramdisk_id='',reservation_id='r-k0oflo0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='992ee33c-41f8-4ea7-bc15-8d73f5a51f6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1436001181',owner_user_name='tempest-SnapshotDataIntegrityTests-1436001181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T19:51:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7e30ec1e9d04b71856c92b6dea20f10',uuid=7eea8605-7538-4c1e-952b-dd6dd5bbc600,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Converting VIF {"id": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "address": "fa:16:3e:15:3c:64", "network": {"id": "78af7dd1-4f54-433c-9625-ccea2da68464", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1176374898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3dd807ba7d4edb806ed31f00fbe41b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b0665-ee", "ovs_interfaceid": "e62b0665-ee67-4ec7-8884-ab2edac6aec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG nova.network.os_vif_util [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:3c:64,bridge_name='br-int',has_traffic_filtering=True,id=e62b0665-ee67-4ec7-8884-ab2edac6aec3,network=Network(78af7dd1-4f54-433c-9625-ccea2da68464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b0665-ee') {{(pid=75205) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG os_vif [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:3c:64,bridge_name='br-int',has_traffic_filtering=True,id=e62b0665-ee67-4ec7-8884-ab2edac6aec3,network=Network(78af7dd1-4f54-433c-9625-ccea2da68464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b0665-ee') {{(pid=75205) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape62b0665-ee, bridge=br-int, if_exists=True) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=222675ea-5729-4045-af7f-abc4af613982) {{(pid=75205) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:40 user nova-compute[75205]: INFO os_vif [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:3c:64,bridge_name='br-int',has_traffic_filtering=True,id=e62b0665-ee67-4ec7-8884-ab2edac6aec3,network=Network(78af7dd1-4f54-433c-9625-ccea2da68464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b0665-ee')
Nov 14 19:57:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Deleting instance files /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600_del
Nov 14 19:57:40 user nova-compute[75205]: INFO nova.virt.libvirt.driver [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Deletion of /opt/stack/data/nova/instances/7eea8605-7538-4c1e-952b-dd6dd5bbc600_del complete
Nov 14 19:57:40 user nova-compute[75205]: INFO nova.compute.manager [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 19:57:40 user nova-compute[75205]: DEBUG oslo.service.loopingcall [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75205) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG nova.compute.manager [-] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Deallocating network for instance {{(pid=75205) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 19:57:40 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] deallocate_for_instance() {{(pid=75205) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 19:57:41 user nova-compute[75205]: DEBUG nova.network.neutron [-] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Updating instance_info_cache with network_info: [] {{(pid=75205) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 19:57:41 user nova-compute[75205]: INFO nova.compute.manager [-] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Took 0.83 seconds to deallocate network for instance.
Nov 14 19:57:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:57:41 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:57:41 user nova-compute[75205]: DEBUG nova.compute.manager [req-03106c77-e950-4e19-89e8-a55775b2aa62 req-08d6999c-eaa6-40a4-b96e-61e2a43043e5 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received event network-vif-deleted-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:57:41 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:57:41 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:57:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:57:42 user nova-compute[75205]: INFO nova.scheduler.client.report [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Deleted allocations for instance 7eea8605-7538-4c1e-952b-dd6dd5bbc600
Nov 14 19:57:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-beb62a6d-d3da-442b-9b24-c681a86eeee9 tempest-SnapshotDataIntegrityTests-1436001181 tempest-SnapshotDataIntegrityTests-1436001181-project-member] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.139s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:57:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-612d6c5e-a34d-4cb8-b358-cfdc75672b12 req-e6835bbe-c369-4679-bb8f-0ec552f14465 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received event network-vif-plugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 19:57:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-612d6c5e-a34d-4cb8-b358-cfdc75672b12 req-e6835bbe-c369-4679-bb8f-0ec552f14465 service nova] Acquiring lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:57:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-612d6c5e-a34d-4cb8-b358-cfdc75672b12 req-e6835bbe-c369-4679-bb8f-0ec552f14465 service nova] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:57:42 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [req-612d6c5e-a34d-4cb8-b358-cfdc75672b12 req-e6835bbe-c369-4679-bb8f-0ec552f14465 service nova] Lock "7eea8605-7538-4c1e-952b-dd6dd5bbc600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:57:42 user nova-compute[75205]: DEBUG nova.compute.manager [req-612d6c5e-a34d-4cb8-b358-cfdc75672b12 req-e6835bbe-c369-4679-bb8f-0ec552f14465 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] No waiting events found dispatching network-vif-plugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 {{(pid=75205) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 19:57:42 user nova-compute[75205]: WARNING nova.compute.manager [req-612d6c5e-a34d-4cb8-b358-cfdc75672b12 req-e6835bbe-c369-4679-bb8f-0ec552f14465 service nova] [instance: 7eea8605-7538-4c1e-952b-dd6dd5bbc600] Received unexpected event network-vif-plugged-e62b0665-ee67-4ec7-8884-ab2edac6aec3 for instance with vm_state deleted and task_state None.
Nov 14 19:57:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:57:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:57:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:57:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:57:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Auditing locally available compute resources for user (node: user) {{(pid=75205) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:00 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:58:00 user nova-compute[75205]: WARNING nova.virt.libvirt.driver [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 19:58:00 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Hypervisor/Node resource view: name=user free_ram=9098MB free_disk=25.025074005126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75205) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75205) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG nova.compute.provider_tree [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed in ProviderTree for provider: 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 {{(pid=75205) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 19:58:00 user nova-compute[75205]: DEBUG nova.scheduler.client.report [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Inventory has not changed for provider 7def1607-b7d5-4fc6-9f9d-da4f8e437fa8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75205) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 19:58:01 user nova-compute[75205]: DEBUG nova.compute.resource_tracker [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Compute_service record updated for user:user {{(pid=75205) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 19:58:01 user nova-compute[75205]: DEBUG oslo_concurrency.lockutils [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 19:58:03 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:58:03 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:58:05 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:07 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:58:07 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75205) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 19:58:08 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:58:09 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:58:10 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:58:10 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Starting heal instance info cache {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 19:58:10 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Rebuilding the list of instances to heal {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 19:58:10 user nova-compute[75205]: DEBUG nova.compute.manager [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Didn't find any instances for network info cache update. {{(pid=75205) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 19:58:10 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:58:10 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:58:11 user nova-compute[75205]: DEBUG oslo_service.periodic_task [None req-b058018c-e198-46b2-b804-98c6e73b0952 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 19:58:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:58:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:58:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:58:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:58:15 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:20 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:58:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:58:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75205) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 19:58:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:58:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75205) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 19:58:25 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:30 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 19:58:31 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:33 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:35 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:36 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:40 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:45 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:50 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 19:58:55 user nova-compute[75205]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75205) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}